00000100:00100000:2.0F:1789892637.713870:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789892637.713903:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055433216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892637.713981:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1789892637.714029:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055433216 00000100:00100000:1.0:1789892637.714053:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055433216 00000100:00100000:1.0:1789892637.714104:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789892637.714116:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055433216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789892637.714137:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892637.714206:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055433216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892637.714213:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789892637.714259:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055433216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0F:1789892637.778797:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892638.395656:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892638.395732:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062726016 00000100:00100000:1.0:1789892638.395743:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062726016 00000100:00100000:3.0:1789892638.395757:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00080000:0.0F:1789892638.395786:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892638.395816:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892638.395835:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062726144 00000100:00100000:1.0:1789892638.395840:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062726144 00000100:00100000:2.0:1789892638.395859:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062725888 00000100:00100000:3.0:1789892638.395884:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 440 00000100:00100000:2.0:1789892638.395884:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062725888 00000100:00100000:3.0:1789892638.395910:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2395:x1876835062726016:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892638.395910:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 441 00000100:00100000:1.0:1789892638.395927:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2394:x1876835062726144:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1789892638.395962:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1778 00000100:00100000:2.0:1789892638.395979:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2394:x1876835062725888:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1789892638.396012:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2395:x1876835062726016:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 105us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892638.396012:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2394:x1876835062726144:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892638.396028:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 441 00000100:00100000:3.0:1789892638.396042:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 440 00000100:00100000:2.0:1789892638.396065:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2394:x1876835062725888:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00080000:1.0:1789892638.396069:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789892638.396083:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1778 00010000:00010000:2.0:1789892638.801814:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789892638.932394:0:214682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc33ae8140 20000000:00000080:1.0:1789892638.932407:0:214682:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9031bad37c00 uarg=0000000000000000 00000040:00100000:1.0:1789892638.932891:0:214682:0:(llog.c:1072:llog_reverse_process()) index 143 : idx 137 00000040:00100000:1.0:1789892638.932898:0:214682:0:(llog.c:1072:llog_reverse_process()) index 135 : idx 93 20000000:01000000:1.0:1789892638.932901:0:214682:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 132 cmd:0xce021 lustre.qpool1 lustre-OST0000_UUID 20000000:01000000:1.0:1789892638.932911:0:214682:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892638.933175:0:214683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 131 marker 140 1->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892638.933259:0:214683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 133 marker 140 2->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892638.933276:0:214683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 144 count 141 00000040:00080000:1.0:1789892638.933449:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].144, 224 off34344 20000000:01000000:1.0:1789892638.933469:0:214682:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892638.933486:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].145, 128 off34472 00000040:00080000:1.0:1789892638.933504:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].146, 224 off34696 20000000:01000000:1.0:1789892638.933517:0:214682:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892638.933927:0:214684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 154 marker 141 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892638.933958:0:214684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 156 marker 141 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892638.933973:0:214684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 166 count 163 00000040:00080000:1.0:1789892638.934071:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].166, 224 off38488 20000000:01000000:1.0:1789892638.934087:0:214682:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892638.934099:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].167, 136 off38624 00000040:00080000:1.0:1789892638.934109:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].168, 224 off38848 20000000:01000000:1.0:1789892638.934118:0:214682:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892638.934403:0:214685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 154 marker 142 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892638.934424:0:214685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 156 marker 142 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892638.934437:0:214685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 166 count 163 00000040:00080000:1.0:1789892638.934523:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].166, 224 off38488 20000000:01000000:1.0:1789892638.934531:0:214682:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892638.934541:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].167, 136 off38624 00000040:00080000:1.0:1789892638.934550:0:214682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].168, 224 off38848 10000000:01000000:1.0:1789892638.934558:0:214682:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892638.934574:0:214682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934589:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62aef0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef05 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934595:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382800/0xd5b980e0d62aef1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef13 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934599:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9c000/0xd5b980e0d62aef28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef21 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934604:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383600/0xd5b980e0d62aef36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef2f expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934608:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aef44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef3d expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934612:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382200/0xd5b980e0d62aef52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef4b expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934616:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382000/0xd5b980e0d62aef60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef59 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934627:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aef6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef67 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934631:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62aef7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aef75 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934638:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d400/0xd5b980e0d62aef83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260328 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934642:0:214682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62aef8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26032f expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934647:0:214682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934700:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62aef8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26032f expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934716:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62aef8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26032f expref: 9 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.934730:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433344:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892638.934812:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d400/0xd5b980e0d62aef83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260328 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934818:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d400/0xd5b980e0d62aef83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260328 expref: 9 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.934824:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433472:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892638.934855:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62aef7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef75 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.934862:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62aef7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef75 expref: 23 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.934867:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433600:0@lo:104: 00000100:00100000:1.0:1789892638.934896:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892638.934943:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aef6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef67 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892638.934950:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055433600 00010000:00010000:1.0:1789892638.934951:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aef6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef67 expref: 23 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892638.934964:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055433600 00000100:00100000:1.0:1789892638.934964:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433728:0@lo:104: 00000100:00100000:1.0:1789892638.934998:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892638.935022:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382000/0xd5b980e0d62aef60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef59 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.935034:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382000/0xd5b980e0d62aef60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef59 expref: 23 pid: 194990 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892638.935036:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055433728 00000100:00100000:2.0:1789892638.935045:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055433728 00000100:00100000:0.0:1789892638.935052:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789892638.935067:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433856:0@lo:104: 00000100:00100000:0.0:1789892638.935073:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214682:x1876835055433600:12345-0@lo:104: 00000100:00100000:3.0:1789892638.935078:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789892638.935093:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214682:x1876835055433728:12345-0@lo:104: 00010000:00010000:0.0:1789892638.935093:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62aef75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef7c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.935113:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892638.935117:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62aef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef6e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892638.935149:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055433856 00000100:00100000:2.0:1789892638.935154:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055433856 00010000:00010000:1.0:1789892638.935160:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382200/0xd5b980e0d62aef52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef4b expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.935175:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382200/0xd5b980e0d62aef52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef4b expref: 23 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892638.935193:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00010000:00010000:0.0:1789892638.935210:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892638.935228:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892638.935230:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433984:0@lo:104: 00000100:00100000:2.0:1789892638.935231:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214682:x1876835055433856:12345-0@lo:104: 00000100:00100000:0.0:1789892638.935243:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214682:x1876835055433600:12345-0@lo:104: Request processed in 168us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892638.935251:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214682:x1876835055433728:12345-0@lo:104: Request processed in 156us (246us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892638.935261:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62aef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef60 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935267:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789892638.935279:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892638.935301:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055433984 00000100:00100000:0.0:1789892638.935309:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055433984 00010000:00010000:2.0:1789892638.935326:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789892638.935326:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aef44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef3d expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935341:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789892638.935342:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214682:x1876835055433856:12345-0@lo:104: Request processed in 127us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892638.935360:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214682:x1876835055433984:12345-0@lo:104: 00000100:00100000:3.0:1789892638.935372:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00010000:1.0:1789892638.935383:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aef44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef3d expref: 23 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.935385:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62aef4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef52 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.935416:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055434112:0@lo:104: 00000100:00100000:2.0:1789892638.935424:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00010000:3.0:1789892638.935446:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892638.935454:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62aef75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef7c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.935457:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892638.935470:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62aef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef6e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.935476:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892638.935481:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98e00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892638.935483:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:3.0:1789892638.935490:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62aef75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef7c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935501:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055433984:12345-0@lo:104: Request processed in 145us (220us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892638.935502:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892638.935507:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62aef75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef7c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892638.935508:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62aef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef6e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.935516:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383600/0xd5b980e0d62aef36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef2f expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935525:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789892638.935552:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055434112 00010000:00010000:2.0:1789892638.935556:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62aef67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef6e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935560:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055434112 10000000:00010000:3.0:1789892638.935561:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62aef75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef7c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.935567:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383600/0xd5b980e0d62aef36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef2f expref: 23 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935594:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 10000000:00010000:2.0:1789892638.935595:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62aef67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef6e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935615:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055434112:12345-0@lo:104: 00000100:00100000:1.0:1789892638.935617:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055434240:0@lo:104: 10000000:01000000:2.0:1789892638.935636:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892638.935639:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98000/0xd5b980e0d62aef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef44 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892638.935649:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892638.935706:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892638.935721:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62aef75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef7c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.935722:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62aef67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef6e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.935740:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892638.935757:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1789892638.935768:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62aef67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef6e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.935769:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9c000/0xd5b980e0d62aef28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef21 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935772:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055434112:12345-0@lo:104: Request processed in 159us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892638.935812:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00010000:2.0:1789892638.935825:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62aef67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef6e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.935828:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892638.935832:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9c000/0xd5b980e0d62aef28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef21 expref: 23 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935845:0:191419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789892638.935851:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892638.935863:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62aef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef60 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935868:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055434240 00000100:00100000:1.0:1789892638.935869:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055434624:0@lo:104: 00000100:00100000:0.0:1789892638.935877:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055434240 00010000:00010000:2.0:1789892638.935891:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99a00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892638.935896:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62aef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef60 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935905:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00010000:00010000:2.0:1789892638.935915:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62aef59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef60 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892638.935922:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62aef59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef60 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.935931:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ca54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055434240:12345-0@lo:104: 00000100:00100000:1.0:1789892638.935937:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892638.935950:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62aef75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef7c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892638.935956:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892638.935956:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62aef2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef36 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.935967:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382800/0xd5b980e0d62aef1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef13 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.935975:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62aef75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef7c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.935988:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62aef59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef60 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.936013:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1789892638.936023:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892638.936024:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789892638.936027:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ca54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055434240:12345-0@lo:104: Request processed in 110us (352us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892638.936036:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62aef4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef52 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936040:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62aef59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef60 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.936057:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:1.0:1789892638.936066:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382800/0xd5b980e0d62aef1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef13 expref: 23 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936068:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892638.936070:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62aef59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef60 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892638.936076:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62aef4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef52 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.936090:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055434624 00000100:00100000:0.0:1789892638.936097:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055434624 00000100:00100000:0.0:1789892638.936116:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00010000:00010000:3.0:1789892638.936120:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62aef4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef52 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936125:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789892638.936128:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055434624:12345-0@lo:104: 00010000:00010000:2.0:1789892638.936131:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98000/0xd5b980e0d62aef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef44 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.936134:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055434752:0@lo:104: 00010000:00010000:0.0:1789892638.936142:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62aef21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef28 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936162:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892638.936169:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98000/0xd5b980e0d62aef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef44 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892638.936175:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62aef4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef52 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892638.936184:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892638.936184:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98000/0xd5b980e0d62aef3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef44 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.936193:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892638.936204:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892638.936211:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62aef4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef52 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.936215:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055434624:12345-0@lo:104: Request processed in 84us (288us total) trans 0 rc 0/0 10000000:00010000:2.0:1789892638.936237:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98000/0xd5b980e0d62aef3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef44 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936243:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892638.936244:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:1.0:1789892638.936254:0:214682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382e00/0xd5b980e0d62aef0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aef05 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936258:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62aef4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef52 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892638.936259:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892638.936261:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055434752 00000100:00100000:0.0:1789892638.936269:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055434752 00010000:00010000:3.0:1789892638.936284:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62aef4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef52 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.936288:0:214682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62aef0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aef05 expref: 23 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.936299:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00010000:00010000:3.0:1789892638.936305:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892638.936305:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98000/0xd5b980e0d62aef3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef44 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.936313:0:214682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055435136:0@lo:104: 00010000:00010000:3.0:1789892638.936315:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62aef2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef36 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.936325:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055434752:12345-0@lo:104: 00010000:00010000:2.0:1789892638.936341:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892638.936344:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c400 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892638.936344:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99e00/0xd5b980e0d62aef13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef1a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892638.936351:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62aef2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef36 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936353:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98000/0xd5b980e0d62aef3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef44 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.936366:0:214682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892638.936384:0:214682:0:(client.c:2702:ptlrpc_set_wait()) set ffff903184ce8c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789892638.936385:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62aef2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef36 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936387:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98000/0xd5b980e0d62aef3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef44 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892638.936409:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62aef2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef36 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936419:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892638.936421:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892638.936423:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433600:0@lo:104: 10000000:01000000:3.0:1789892638.936424:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892638.936431:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62aef21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef28 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.936443:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055434752:12345-0@lo:104: Request processed in 119us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892638.936454:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433728:0@lo:104: 00010000:00010000:3.0:1789892638.936456:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62aef2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef36 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.936466:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00010000:2.0:1789892638.936467:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892638.936481:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62aef21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef28 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936482:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892638.936492:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62aef2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef36 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936497:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62aef21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef28 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936499:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62aef2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef36 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.936505:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433856:0@lo:104: 00000100:00100000:0.0:1789892638.936506:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055435136 00000100:00100000:0.0:1789892638.936518:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055435136 00000100:00100000:1.0:1789892638.936530:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433984:0@lo:104: 10000000:00010000:2.0:1789892638.936534:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62aef21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef28 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892638.936550:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892638.936557:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00010000:00010000:3.0:1789892638.936560:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892638.936560:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055434112:0@lo:104: 00000100:00100000:0.0:1789892638.936574:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055435136:12345-0@lo:104: 00010000:00010000:3.0:1789892638.936576:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99e00/0xd5b980e0d62aef13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef1a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936577:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62aef21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef28 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.936585:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055434240:0@lo:104: 00010000:00010000:0.0:1789892638.936589:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62aef05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef0c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936612:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99e00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:1.0:1789892638.936614:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055434624:0@lo:104: 00010000:00010000:2.0:1789892638.936624:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1789892638.936625:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99e00/0xd5b980e0d62aef13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef1a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936643:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99e00/0xd5b980e0d62aef13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef1a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936646:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62aef21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef28 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.936648:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055434752:0@lo:104: 00010000:00010000:0.0:1789892638.936656:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892638.936727:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62aef21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef28 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.936733:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055435136:0@lo:104: 00000100:00100000:0.0:1789892638.936738:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214682:x1876835055435136:12345-0@lo:104: Request processed in 108us (322us total) trans 0 rc 0/0 10000000:00010000:3.0:1789892638.936739:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99e00/0xd5b980e0d62aef13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef1a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892638.936761:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892638.936765:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892638.936767:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:2.0:1789892638.936773:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62aef05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aef0c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936779:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99e00/0xd5b980e0d62aef13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef1a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936782:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9da00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892638.936788:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789892638.936790:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62aef05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aef0c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.936807:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99e00/0xd5b980e0d62aef13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef1a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936807:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62aef05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aef0c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.936812:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892638.936825:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892638.936832:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055434880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892638.936841:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99e00/0xd5b980e0d62aef13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef1a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892638.936841:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62aef05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aef0c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892638.936861:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892638.936866:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892638.936868:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055434496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892638.936871:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892638.936879:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892638.936883:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892638.936897:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62aef05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef0c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.936906:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892638.936922:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62aef05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef0c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.936936:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055435520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892638.936937:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892638.936939:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62aef05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aef0c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.936990:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055435264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892638.936993:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892638.937000:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892638.937001:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892638.937008:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892638.937027:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892638.937033:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055435008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892638.937062:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789892638.937072:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055434368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892638.937090:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892638.937105:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892638.937112:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433344:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892638.937120:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055435648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892638.937137:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055434880 00000100:00100000:0.0:1789892638.937141:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055434880 00000100:00100000:1.0:1789892638.937144:0:214682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214682:1876835055433472:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892638.937180:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892638.937184:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382000/0xd5b980e0d62aef60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef59 expref: 24 pid: 194990 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892638.937234:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055434496 00000100:00100000:0.0:1789892638.937241:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055435520 00000100:00100000:3.0:1789892638.937242:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055434496 00000100:00100000:0.0:1789892638.937247:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055435520 00000100:00100000:2.0:1789892638.937262:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789892638.937279:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aef6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef67 expref: 26 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.937280:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9c000/0xd5b980e0d62aef28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef21 expref: 26 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892638.937281:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055435776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892638.937287:0:214682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.937323:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055435008 00000100:00100000:0.0:1789892638.937332:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055435008 00000100:00100000:2.0:1789892638.937333:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892638.937352:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062726400 00010000:00010000:0.0:1789892638.937355:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382200/0xd5b980e0d62aef52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef4b expref: 27 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892638.937359:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062726400 00000100:00100000:0.0:1789892638.937376:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055435648 00000100:00100000:0.0:1789892638.937380:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055435648 00000100:00100000:2.0:1789892638.937388:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055435776 00010000:00010000:3.0:1789892638.937391:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d400/0xd5b980e0d62aef83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260328 expref: 10 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.937391:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892638.937395:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055435776 00010000:00010000:0.0:1789892638.937400:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382800/0xd5b980e0d62aef1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef13 expref: 28 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.937420:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382e00/0xd5b980e0d62aef0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef05 expref: 29 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.937443:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055435264 00000100:00100000:0.0:1789892638.937449:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055435264 00000100:00100000:1.0:1789892638.937466:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00010000:00010000:0.0:1789892638.937468:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aef44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef3d expref: 30 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892638.937477:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789892638.937485:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3619:x1876835055434880:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892638.937495:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00010000:00010000:1.0:1789892638.937500:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892638.937502:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3619:x1876835055435520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892638.937512:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382000/0xd5b980e0d62aef60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef59 expref: 30 pid: 194990 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892638.937514:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3621:x1876835055434496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892638.937520:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892638.937527:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00010000:00010000:2.0:1789892638.937540:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9c000/0xd5b980e0d62aef28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef21 expref: 30 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.937547:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892638.937551:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382000/0xd5b980e0d62aef60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef59 expref: 30 pid: 194990 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892638.937554:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3620:x1876835055435008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892638.937561:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aef6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef67 expref: 30 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.937578:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892638.937595:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382200/0xd5b980e0d62aef52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef4b expref: 30 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.937601:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9c000/0xd5b980e0d62aef28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef21 expref: 30 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.937630:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382000/0xd5b980e0d62aef60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef59 expref: 30 pid: 194990 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.937635:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aef6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef67 expref: 30 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.937654:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382200/0xd5b980e0d62aef52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef4b expref: 29 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.937718:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9c000/0xd5b980e0d62aef28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef21 expref: 29 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.937829:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892638.937840:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aef6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef67 expref: 28 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.937845:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892638.937845:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382200/0xd5b980e0d62aef52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef4b expref: 28 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.937866:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892638.937882:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892638.937883:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055434880:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892638.937898:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789892638.937912:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055435520:12345-0@lo:103:ldlm_bl.0 Request processed in 413us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892638.937926:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1789892638.937944:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055435008:12345-0@lo:103:ldlm_bl.0 Request processed in 390us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892638.937945:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 417 00000100:00100000:3.0:1789892638.937962:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3621:x1876835055434496:12345-0@lo:103:ldlm_bl.0 Request processed in 449us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892638.937971:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1789892638.937974:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2395:x1876835062726400:12345-192.168.203.53@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789892638.937988:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789892638.937990:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055435648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892638.937992:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892638.938002:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:1.0:1789892638.938009:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d400/0xd5b980e0d62aef83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260328 expref: 10 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.938012:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892638.938019:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00010000:00010000:2.0:1789892638.938031:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382800/0xd5b980e0d62aef1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef13 expref: 22 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892638.938040:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789892638.938041:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3620:x1876835055435776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892638.938045:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d400/0xd5b980e0d62aef83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260328 expref: 10 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.938063:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892638.938068:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bdedf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3621:x1876835055435264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892638.938077:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382e00/0xd5b980e0d62aef0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef05 expref: 22 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.938092:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892638.938108:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aef44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef3d expref: 22 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.938109:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382800/0xd5b980e0d62aef1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef13 expref: 22 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.938136:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382e00/0xd5b980e0d62aef0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef05 expref: 22 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938155:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d400/0xd5b980e0d62aef83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260328 expref: 10 pid: 190664 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.938157:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aef44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef3d expref: 22 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.938190:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382800/0xd5b980e0d62aef1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef13 expref: 22 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938192:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892638.938193:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62aef0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef05 expref: 22 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.938204:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aef44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef3d expref: 22 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.938243:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892638.938243:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892638.938246:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892638.938255:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2395:x1876835062726400:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 280us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892638.938263:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 417 00000100:00100000:0.0:1789892638.938297:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055435776:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892638.938305:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1789892638.938315:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055435648:12345-0@lo:103:ldlm_bl.0 Request processed in 329us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892638.938319:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bdedf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3621:x1876835055435264:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892638.938333:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892638.938350:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1789892638.938361:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055434368 00000100:00100000:3.0:1789892638.938362:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789892638.938368:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055434368 00010000:00010000:0.0:1789892638.938390:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62aef7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef75 expref: 17 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.938417:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055435392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892638.938439:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789892638.938443:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055434496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892638.938457:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3619:x1876835055434368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892638.938469:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892638.938470:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892638.938471:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055435264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892638.938481:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62aef7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef75 expref: 17 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.938495:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62aef7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef75 expref: 17 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.938512:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62aef7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef75 expref: 17 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892638.938529:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892638.938540:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055434880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892638.938557:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892638.938566:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055435520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892638.938598:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055434368:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892638.938612:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789892638.938625:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055435392 00000100:00100000:1.0:1789892638.938625:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055434368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892638.938632:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055435392 00000100:00100000:2.0:1789892638.938633:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055435776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892638.938635:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062726272 00000100:00100000:0.0:1789892638.938643:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062726272 00010000:00010000:3.0:1789892638.938660:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383600/0xd5b980e0d62aef36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef2f expref: 16 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892638.938674:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055435008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892638.938714:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62aef8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26032f expref: 9 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892638.938720:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789892638.938739:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055435392:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892638.938739:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055435648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892638.938754:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 423 00010000:00010000:3.0:1789892638.938770:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892638.938771:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2397:x1876835062726272:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892638.938782:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383600/0xd5b980e0d62aef36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aef2f expref: 16 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938788:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892638.938797:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383600/0xd5b980e0d62aef36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aef2f expref: 16 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938798:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62aef8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26032f expref: 9 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.938838:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383600/0xd5b980e0d62aef36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aef2f expref: 16 pid: 190662 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938870:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62aef8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26032f expref: 9 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892638.938878:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892638.938887:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62aef8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26032f expref: 9 pid: 190663 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938903:0:190656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938910:0:190656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938921:0:190656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892638.938923:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055435392:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892638.938940:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055435392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892638.938943:0:190656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892638.938957:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00010000:00010000:1.0:1789892638.938962:0:190656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938969:0:190656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938975:0:190656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7600 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:1.0:1789892638.938979:0:190656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.938986:0:190656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.939010:0:190656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892638.939017:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892638.939050:0:214682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892638.939050:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2397:x1876835062726272:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 282us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892638.939073:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 423 00010000:00010000:2.0:1789892638.939074:0:214682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892638.939086:0:214682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7600/0xd5b980e0d62aef91 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892639.825931:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892640.123864:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892640.123931:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062726528 00000100:00100000:0.0:1789892640.123943:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062726528 00000100:00100000:0.0:1789892640.124002:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1779 00000100:00100000:0.0:1789892640.124011:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062726528:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892640.124031:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892640.124064:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260336 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892640.124093:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892640.124103:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892640.124112:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98200, rc 0) 00000100:00100000:0.0:1789892640.124181:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062726528:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 172us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892640.124187:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1779 00000100:00100000:0.0:1789892640.125175:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892640.125242:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062726656 00000100:00100000:1.0:1789892640.125256:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062726656 00000100:00100000:1.0:1789892640.125313:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1780 00000100:00100000:1.0:1789892640.125322:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062726656:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.125458:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062726656:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 138us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892640.125465:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1780 00000100:00100000:2.0:1789892640.126165:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892640.126229:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062726784 00000100:00100000:3.0:1789892640.126236:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062726784 00000100:00100000:3.0:1789892640.126279:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1781 00000100:00100000:3.0:1789892640.126291:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062726784:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892640.126420:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062726784:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 131us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.126431:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1781 00000100:00100000:3.0:1789892640.127452:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892640.127496:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062726912 00000100:00100000:2.0:1789892640.127501:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062726912 00000100:00100000:2.0:1789892640.127561:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1782 00000100:00100000:2.0:1789892640.127579:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214280:x1876835062726912:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892640.127717:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214280:x1876835062726912:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 146us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.127723:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1782 00000100:00100000:0.0:1789892640.128445:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892640.128487:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062727040 00000100:00100000:2.0:1789892640.128491:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062727040 00000100:00100000:2.0:1789892640.128513:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1783 00000100:00100000:2.0:1789892640.128518:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214280:x1876835062727040:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892640.128573:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214280:x1876835062727040:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 53us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.128578:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1783 00000100:00100000:3.0:1789892640.129453:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892640.129510:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062727168 00000100:00100000:1.0:1789892640.129519:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062727168 00000100:00100000:1.0:1789892640.129563:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1784 00000100:00100000:1.0:1789892640.129573:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062727168:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.129584:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892640.129603:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26033d expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.129629:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.129638:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.129663:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6c00, rc 0) 00000100:00100000:1.0:1789892640.129740:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062727168:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 168us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892640.129750:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1784 00000100:00100000:3.0:1789892640.130460:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892640.130508:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062727296 00000100:00100000:0.0:1789892640.130514:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062727296 00000100:00100000:0.0:1789892640.130548:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1785 00000100:00100000:0.0:1789892640.130557:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062727296:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892640.130631:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062727296:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 74us (172us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892640.130641:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1785 00000100:00100000:0.0:1789892640.785904:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055435904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892640.786015:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892640.786069:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055435904 00000100:00100000:3.0:1789892640.786081:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055435904 00000100:00100000:3.0:1789892640.786150:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789892640.786181:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055435904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789892640.786243:0:190693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789892640.786313:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055435904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.786322:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789892640.786369:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055435904:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789892640.849967:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892640.977775:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892640.977787:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 144 10000000:01000000:1.0:1789892640.977795:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892640.977859:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.977874:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.977887:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.977922:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.978011:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.978082:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185311780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.978098:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055436032 00000100:00100000:2.0:1789892640.978133:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055436032 00000100:00100000:2.0:1789892640.978226:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:2.0:1789892640.978237:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055436032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892640.978252:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892640.978266:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62aefa6 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.978292:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.978302:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.978311:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382a00, rc 0) 00000100:00100000:2.0:1789892640.978353:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055436032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.978359:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:1.0:1789892640.978399:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.978419:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.978431:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.978520:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.978550:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.978570:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185311780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.978589:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055436160 00000100:00100000:2.0:1789892640.978593:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055436160 00000100:00100000:2.0:1789892640.978616:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:2.0:1789892640.978620:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055436160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.978767:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055436160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.978773:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:1.0:1789892640.978811:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.978849:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.978895:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.978925:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185311780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.978952:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055436288 00000100:00100000:2.0:1789892640.978958:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055436288 00000100:00100000:2.0:1789892640.978987:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:2.0:1789892640.978993:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055436288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.979086:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055436288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.979092:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:1.0:1789892640.979122:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.979499:0:214686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214686:1876835055436416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.979531:0:214686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.979548:0:214686:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089a96600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.979580:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055436416 00000100:00100000:0.0:1789892640.979586:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055436416 00000100:00100000:0.0:1789892640.979619:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:0.0:1789892640.979626:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214686:x1876835055436416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892640.979738:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214686:x1876835055436416:12345-0@lo:502:llog_process_th.0 Request processed in 112us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892640.979746:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1789892640.979781:0:214686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214686:1876835055436416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.979833:0:214686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214686:1876835055436544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.979861:0:214686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.979880:0:214686:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089a96600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.979910:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055436544 00000100:00100000:3.0:1789892640.979917:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055436544 00000100:00100000:3.0:1789892640.979950:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:3.0:1789892640.979959:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214686:x1876835055436544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.980048:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214686:x1876835055436544:12345-0@lo:502:llog_process_th.0 Request processed in 89us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.980054:0:214686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214686:1876835055436544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.980060:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 00000040:00080000:2.0:1789892640.980075:0:214686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789892640.980165:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789892640.980193:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892640.980213:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.980224:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892640.980233:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892640.980235:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789892640.980238:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892640.980253:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.980261:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.980270:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.980290:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.980318:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.980336:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.980432:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055436672 00000100:00100000:2.0:1789892640.980436:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055436672 00000100:00100000:2.0:1789892640.980458:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791 00000100:00100000:2.0:1789892640.980462:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055436672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892640.980468:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892640.980475:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62aefb4 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.980487:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 17 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.980494:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 17 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.980509:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383000, rc 0) 00000100:00100000:2.0:1789892640.980536:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055436672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.980541:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791 00000100:00100000:1.0:1789892640.980577:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.980590:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.980599:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.980639:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.980664:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.980710:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055436800 00000100:00100000:2.0:1789892640.980714:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055436800 00000100:00100000:1.0:1789892640.980720:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.980744:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:2.0:1789892640.980750:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055436800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.980809:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055436800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.980814:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:1.0:1789892640.980839:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.980865:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.980902:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.980921:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.980936:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055436928 00000100:00100000:0.0:1789892640.980942:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055436928 00000100:00100000:0.0:1789892640.980969:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1789892640.980976:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055436928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892640.981045:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055436928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892640.981051:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:1.0:1789892640.981071:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055436928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892640.981649:0:214687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:1.0:1789892640.981708:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:1.0:1789892640.981729:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892640.981735:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.981744:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892640.981759:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892640.981761:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 144 10000000:01000000:1.0:1789892640.981764:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892640.981777:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.981785:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.981794:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.981807:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.981833:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.981857:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.981882:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055437056 00000100:00100000:3.0:1789892640.981888:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055437056 00000100:00100000:3.0:1789892640.981915:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:3.0:1789892640.981922:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055437056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892640.981930:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892640.981940:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62aefc2 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.981957:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.981966:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.981974:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9de00, rc 0) 00000100:00100000:3.0:1789892640.982009:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055437056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.982025:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00100000:1.0:1789892640.982044:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.982058:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.982067:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.982105:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.982131:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.982148:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.982158:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055437184 00000100:00100000:2.0:1789892640.982163:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055437184 00000100:00100000:2.0:1789892640.982185:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:2.0:1789892640.982190:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055437184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.982271:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055437184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.982277:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:1.0:1789892640.982296:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.982330:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.982366:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.982385:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055437312 00000100:00100000:1.0:1789892640.982385:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.982389:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055437312 00000100:00100000:2.0:1789892640.982411:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:2.0:1789892640.982415:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055437312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.982468:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055437312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.982482:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1789892640.982496:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.982749:0:214688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214688:1876835055437440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.982777:0:214688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.982798:0:214688:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a1c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.982810:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055437440 00000100:00100000:0.0:1789892640.982816:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055437440 00000100:00100000:0.0:1789892640.982841:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:0.0:1789892640.982847:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214688:x1876835055437440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892640.982924:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214688:x1876835055437440:12345-0@lo:502:llog_process_th.0 Request processed in 74us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.982931:0:214688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214688:1876835055437440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892640.982936:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00100000:2.0:1789892640.982965:0:214688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214688:1876835055437568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.982995:0:214688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.983008:0:214688:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a1c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.983037:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055437568 00000100:00100000:3.0:1789892640.983043:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055437568 00000100:00100000:3.0:1789892640.983070:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798 00000100:00100000:3.0:1789892640.983079:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214688:x1876835055437568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.983152:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214688:x1876835055437568:12345-0@lo:502:llog_process_th.0 Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.983161:0:214688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214688:1876835055437568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.983162:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798 00000040:00080000:2.0:1789892640.983192:0:214688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789892640.983275:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789892640.983291:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892640.983298:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.983306:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892640.983314:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892640.983317:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:1.0:1789892640.983319:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892640.983334:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.983342:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.983351:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.983365:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.983392:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.983411:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.983412:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055437696 00000100:00100000:2.0:1789892640.983417:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055437696 00000100:00100000:2.0:1789892640.983441:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799 00000100:00100000:2.0:1789892640.983446:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055437696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892640.983451:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892640.983458:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62aefd0 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.983471:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 19 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.983477:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 19 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.983482:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382600, rc 0) 00000100:00100000:2.0:1789892640.983513:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055437696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.983518:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799 00000100:00100000:1.0:1789892640.983544:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.983564:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.983573:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.983610:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.983638:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.983654:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.983665:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055437824 00000100:00100000:2.0:1789892640.983671:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055437824 00000100:00100000:2.0:1789892640.983709:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:2.0:1789892640.983714:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055437824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.983770:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055437824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.983775:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00100000:1.0:1789892640.983798:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.983825:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.983860:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.983887:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.983901:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055437952 00000100:00100000:0.0:1789892640.983906:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055437952 00000100:00100000:0.0:1789892640.983928:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:0.0:1789892640.983933:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055437952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892640.984020:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055437952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892640.984030:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:1.0:1789892640.984048:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055437952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892640.984708:0:214689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:1.0:1789892640.984781:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:1.0:1789892640.984796:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892640.984802:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.984811:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892640.984820:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892640.984822:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 144 10000000:01000000:1.0:1789892640.984825:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892640.984840:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.984859:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.984867:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.984880:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.984908:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.984932:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.984958:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055438080 00000100:00100000:3.0:1789892640.984964:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055438080 00000100:00100000:3.0:1789892640.984991:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:3.0:1789892640.984998:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055438080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892640.985007:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892640.985016:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62aefde expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.985030:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.985040:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.985047:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d000, rc 0) 00000100:00100000:3.0:1789892640.985080:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055438080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.985088:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1789892640.985118:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.985131:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.985140:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.985178:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.985217:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.985234:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.985250:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055438208 00000100:00100000:2.0:1789892640.985256:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055438208 00000100:00100000:2.0:1789892640.985279:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:2.0:1789892640.985284:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055438208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.985336:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055438208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.985343:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:1.0:1789892640.985366:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.985391:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.985428:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.985447:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055438336 00000100:00100000:1.0:1789892640.985447:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.985451:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055438336 00000100:00100000:2.0:1789892640.985473:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:2.0:1789892640.985477:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055438336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.985548:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055438336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.985557:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1789892640.985572:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.985810:0:214690:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214690:1876835055438464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.985845:0:214690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.985865:0:214690:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318582e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.985883:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055438464 00000100:00100000:0.0:1789892640.985890:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055438464 00000100:00100000:0.0:1789892640.985928:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:0.0:1789892640.985939:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214690:x1876835055438464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.986033:0:214690:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214690:1876835055438464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892640.986040:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214690:x1876835055438464:12345-0@lo:502:llog_process_th.0 Request processed in 100us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892640.986052:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00100000:2.0:1789892640.986067:0:214690:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214690:1876835055438592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.986099:0:214690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.986112:0:214690:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318582e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.986141:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055438592 00000100:00100000:3.0:1789892640.986153:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055438592 00000100:00100000:3.0:1789892640.986180:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:3.0:1789892640.986188:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214690:x1876835055438592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.986280:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214690:x1876835055438592:12345-0@lo:502:llog_process_th.0 Request processed in 92us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.986289:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1789892640.986292:0:214690:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214690:1876835055438592:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892640.986314:0:214690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789892640.986378:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789892640.986400:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892640.986407:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.986415:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892640.986424:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892640.986426:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 166 10000000:01000000:1.0:1789892640.986429:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892640.986443:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.986452:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.986460:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.986472:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.986499:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.986526:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.986546:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055438720 00000100:00100000:2.0:1789892640.986552:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055438720 00000100:00100000:2.0:1789892640.986581:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:2.0:1789892640.986588:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055438720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892640.986596:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892640.986606:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62aefec expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.986622:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 21 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.986629:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 21 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.986634:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383400, rc 0) 00000100:00100000:2.0:1789892640.986660:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055438720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.986665:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1789892640.986723:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.986736:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.986744:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.986780:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.986813:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.986833:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055438848 00000100:00100000:2.0:1789892640.986837:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055438848 00000100:00100000:1.0:1789892640.986839:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.986863:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:2.0:1789892640.986868:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055438848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.986931:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055438848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.986937:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:1.0:1789892640.986960:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.986985:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.987027:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.987045:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.987077:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055438976 00000100:00100000:0.0:1789892640.987084:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055438976 00000100:00100000:0.0:1789892640.987120:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1789892640.987130:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055438976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892640.987241:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055438976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892640.987250:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:1.0:1789892640.987263:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055438976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892640.987455:0:214691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214691:1876835055439104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.987485:0:214691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.987504:0:214691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031b7709240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.987539:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055439104 00000100:00100000:3.0:1789892640.987545:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055439104 00000100:00100000:3.0:1789892640.987569:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:3.0:1789892640.987578:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214691:x1876835055439104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.987660:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214691:x1876835055439104:12345-0@lo:502:llog_process_th.0 Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.987667:0:214691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214691:1876835055439104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.987673:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000020:01000000:2.0:1789892640.987707:0:214691:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892640.987718:0:214691:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892640.987720:0:214691:0:(obd_config.c:1561:class_process_config()) marker 154 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:2.0:1789892640.987726:0:214691:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789892640.987744:0:214691:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000100:00100000:2.0:1789892640.987759:0:214691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214691:1876835055439232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.987786:0:214691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892640.987805:0:214691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031b7709240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.987834:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055439232 00000100:00100000:0.0:1789892640.987840:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055439232 00000100:00100000:0.0:1789892640.987883:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:0.0:1789892640.987892:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214691:x1876835055439232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892640.987985:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214691:x1876835055439232:12345-0@lo:502:llog_process_th.0 Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.987995:0:214691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214691:1876835055439232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892640.987997:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000020:01000000:2.0:1789892640.988015:0:214691:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892640.988020:0:214691:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892640.988022:0:214691:0:(obd_config.c:1561:class_process_config()) marker 154 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:2.0:1789892640.988024:0:214691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 169 count 166 00000020:01000000:1.0:1789892640.988088:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 166-168 (rc=0) 10000000:01000000:1.0:1789892640.988105:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892640.988112:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.988120:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892640.988130:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892640.988132:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 144 10000000:01000000:1.0:1789892640.988135:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892640.988150:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.988158:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.988166:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.988179:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055439360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.988239:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.988255:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.988265:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055439360 00000100:00100000:2.0:1789892640.988270:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055439360 00000100:00100000:2.0:1789892640.988293:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:2.0:1789892640.988306:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055439360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892640.988313:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892640.988320:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62aeffa expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.988332:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.988339:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892640.988345:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383200, rc 0) 00000100:00100000:2.0:1789892640.988370:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055439360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.988376:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:1.0:1789892640.988398:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055439360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.988411:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.988420:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.988458:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055439488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.988497:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.988514:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.988541:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055439488 00000100:00100000:3.0:1789892640.988547:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055439488 00000100:00100000:3.0:1789892640.988575:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:3.0:1789892640.988582:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055439488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892640.988653:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055439488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.988661:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:1.0:1789892640.988712:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055439488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.988742:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055439616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.988777:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.988802:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.988820:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055439616 00000100:00100000:3.0:1789892640.988825:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055439616 00000100:00100000:3.0:1789892640.988853:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1789892640.988860:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055439616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892640.988927:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055439616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892640.988947:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055439616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892640.988948:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1789892640.989191:0:214692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214692:1876835055439744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.989241:0:214692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892640.989259:0:214692:0:(client.c:2702:ptlrpc_set_wait()) set ffff903084af90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.989277:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055439744 00000100:00100000:0.0:1789892640.989282:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055439744 00000100:00100000:0.0:1789892640.989304:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1789892640.989309:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214692:x1876835055439744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892640.989371:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214692:x1876835055439744:12345-0@lo:502:llog_process_th.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892640.989382:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:3.0:1789892640.989393:0:214692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214692:1876835055439744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.989435:0:214692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214692:1876835055439872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.989469:0:214692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892640.989487:0:214692:0:(client.c:2702:ptlrpc_set_wait()) set ffff903084af90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.989500:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055439872 00000100:00100000:2.0:1789892640.989504:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055439872 00000100:00100000:2.0:1789892640.989526:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:2.0:1789892640.989531:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214692:x1876835055439872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.989585:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214692:x1876835055439872:12345-0@lo:502:llog_process_th.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.989592:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:3.0:1789892640.989608:0:214692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214692:1876835055439872:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892640.989632:0:214692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789892640.989721:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789892640.989748:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892640.989759:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.989768:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892640.989777:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892640.989785:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 166 10000000:01000000:1.0:1789892640.989788:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892640.989803:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.989811:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.989820:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.989833:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.989860:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.989885:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.989896:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055440000 00000100:00100000:3.0:1789892640.989902:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055440000 00000100:00100000:3.0:1789892640.989930:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:3.0:1789892640.989936:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055440000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892640.989944:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892640.989953:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af008 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.989968:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.989978:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.989986:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c400, rc 0) 00000100:00100000:3.0:1789892640.990025:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055440000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.990034:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:1.0:1789892640.990060:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.990073:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.990082:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.990119:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.990146:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.990170:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.990184:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055440128 00000100:00100000:3.0:1789892640.990189:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055440128 00000100:00100000:3.0:1789892640.990225:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:3.0:1789892640.990233:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055440128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892640.990297:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055440128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.990305:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:1.0:1789892640.990325:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.990351:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.990389:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.990412:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.990445:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055440256 00000100:00100000:0.0:1789892640.990453:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055440256 00000100:00100000:0.0:1789892640.990488:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:0.0:1789892640.990499:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055440256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892640.990590:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055440256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892640.990600:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:1.0:1789892640.990612:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892640.990853:0:214693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214693:1876835055440384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892640.990890:0:214693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892640.990915:0:214693:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892640.990927:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055440384 00000100:00100000:2.0:1789892640.990931:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055440384 00000100:00100000:2.0:1789892640.990954:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:2.0:1789892640.990959:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214693:x1876835055440384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892640.991027:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214693:x1876835055440384:12345-0@lo:502:llog_process_th.0 Request processed in 67us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892640.991037:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000100:00100000:3.0:1789892640.991041:0:214693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214693:1876835055440384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892640.991068:0:214693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892640.991075:0:214693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892640.991077:0:214693:0:(obd_config.c:1561:class_process_config()) marker 153 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:3.0:1789892640.991082:0:214693:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789892640.991090:0:214693:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000020:01000004:3.0:1789892640.991458:0:214694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789892640.991464:0:214694:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:0.0:1789892640.991467:0:214693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214693:1876835055440512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892640.991518:0:214693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892640.991547:0:214693:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a739c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892640.991575:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055440512 00000100:00100000:1.0:1789892640.991581:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055440512 00000100:00100000:1.0:1789892640.991618:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:1.0:1789892640.991628:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214693:x1876835055440512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892640.991736:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214693:x1876835055440512:12345-0@lo:502:llog_process_th.0 Request processed in 109us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892640.991745:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1789892640.991761:0:214693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214693:1876835055440512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892640.991792:0:214693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892640.991797:0:214693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892640.991799:0:214693:0:(obd_config.c:1561:class_process_config()) marker 153 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:0.0:1789892640.991804:0:214693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 169 count 166 00000020:01000000:1.0:1789892640.991863:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 166-168 (rc=0) 10000000:01000000:1.0:1789892640.991884:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892640.991890:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.991899:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892640.991908:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892640.991910:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:1.0:1789892640.991913:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892640.991927:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.991936:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.991944:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.991968:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.991994:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.992019:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892640.992031:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055440640 00000100:00100000:3.0:1789892640.992037:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055440640 00000100:00100000:3.0:1789892640.992066:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:3.0:1789892640.992075:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055440640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892640.992083:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892640.992091:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af016 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.992113:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 24 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.992122:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 24 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892640.992130:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c600, rc 0) 00000100:00100000:3.0:1789892640.992162:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055440640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892640.992170:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:1.0:1789892640.992197:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892640.992222:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.992231:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892640.992268:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892640.992295:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892640.992311:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402480 going to sleep for 11 seconds 00000100:00100000:0.0:1789892640.992334:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055440768 00000100:00100000:0.0:1789892640.992342:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055440768 00000100:00100000:0.0:1789892640.992368:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:0.0:1789892640.992377:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055440768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892640.992438:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055440768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (141us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892640.992446:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:1.0:1789892640.992456:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055440768:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789892640.992483:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892640.992488:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892640.992497:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892641.297898:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055441152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892641.297898:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055441280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892641.298005:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892641.298039:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055441280 00000100:00100000:0.0:1789892641.298046:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055441408:0@lo:400:kworker.0 00000100:00100000:3.0:1789892641.298051:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055441280 00000100:00100000:2.0:1789892641.298064:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055441664:0@lo:400:kworker.0 00000100:00100000:1.0:1789892641.298087:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055441536:0@lo:400:kworker.0 00000100:00100000:0.0:1789892641.298109:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892641.298110:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892641.298136:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055442176:0@lo:400:kworker.0 00000100:00080000:1.0:1789892641.298138:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789892641.298145:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789892641.298159:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892641.298164:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055441280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892641.298173:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892641.298177:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055441920:0@lo:400:kworker.0 00000100:00100000:1.0:1789892641.298193:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055442048:0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.298199:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876835055442688:0@lo:400:kworker.0 00002000:00000024:3.0:1789892641.298226:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892641.298234:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892641.298265:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876835055442432:0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.298269:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892641.298269:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892641.298299:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055441280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892641.298309:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789892641.298344:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055441408 00000100:00100000:3.0:1789892641.298349:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055441408 00000100:00100000:1.0:1789892641.298363:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876835055442560:0@lo:400:kworker.0 00000100:00100000:0.0:1789892641.298372:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892641.298399:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055441280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892641.298403:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892641.298404:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055441536 00000100:00100000:3.0:1789892641.298411:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055441536 00000100:00100000:0.0:1789892641.298412:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789892641.298424:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055441792:0@lo:400:kworker.0 00000100:00100000:3.0:1789892641.298437:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055441920 00000100:00100000:3.0:1789892641.298442:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055441920 00000100:00100000:2.0:1789892641.298446:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055441664 00000100:00100000:2.0:1789892641.298453:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055441664 00000100:00100000:1.0:1789892641.298457:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055442048 00000100:00100000:1.0:1789892641.298463:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055442048 00000100:00100000:0.0:1789892641.298469:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892641.298475:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789892641.298488:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055441408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892641.298503:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789892641.298504:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055442304:0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.298508:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055442176 00000100:00100000:2.0:1789892641.298513:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055442176 00000100:00100000:1.0:1789892641.298517:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055441536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.298541:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055442688 00000100:00100000:2.0:1789892641.298546:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055442688 00000100:00100000:0.0:1789892641.298555:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892641.298562:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055441408:12345-0@lo:400:kworker.0 Request processed in 77us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892641.298573:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055442432 00000100:00100000:3.0:1789892641.298574:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789892641.298580:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055442432 00000100:00100000:1.0:1789892641.298581:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055441536:12345-0@lo:400:kworker.0 Request processed in 67us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892641.298591:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789892641.298594:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055441408:0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.298605:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055442560 00000100:00100000:2.0:1789892641.298609:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055442560 00000100:00100000:1.0:1789892641.298619:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789892641.298627:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789892641.298632:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055441920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.298633:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1789892641.298643:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055442048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892641.298646:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055442304 00000100:00100000:2.0:1789892641.298647:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055441664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892641.298655:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055442304 00000100:00100000:1.0:1789892641.298669:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055441920:12345-0@lo:400:kworker.0 Request processed in 42us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892641.298675:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789892641.298732:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1789892641.298739:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055442048:12345-0@lo:400:kworker.0 Request processed in 97us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892641.298739:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055441664:12345-0@lo:400:kworker.0 Request processed in 95us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892641.298743:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789892641.298746:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876835055442176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892641.298760:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876835055442688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.298763:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1789892641.298766:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789892641.298794:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876835055442176:12345-0@lo:400:kworker.0 Request processed in 52us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892641.298797:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00080000:3.0:1789892641.298808:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892641.298812:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00080000:3.0:1789892641.298815:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892641.298820:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789892641.298821:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876835055442432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892641.298826:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876835055442688:12345-0@lo:400:kworker.0 Request processed in 68us (562us total) trans 0 rc 0/0 00000100:00080000:3.0:1789892641.298828:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892641.298836:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1789892641.298844:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789892641.298849:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876835055442560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.298868:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876835055442432:12345-0@lo:400:kworker.0 Request processed in 53us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892641.298876:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789892641.298878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892641.298888:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789892641.298889:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876835055442560:12345-0@lo:400:kworker.0 Request processed in 42us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892641.298894:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055442304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892641.298901:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789892641.298916:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055440896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892641.298941:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055441664:0@lo:400:kworker.0 00000100:00100000:1.0:1789892641.298945:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055441792 00000100:00100000:1.0:1789892641.298951:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055441792 00000100:00100000:0.0:1789892641.298951:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055442304:12345-0@lo:400:kworker.0 Request processed in 60us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892641.298957:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055442176:0@lo:400:kworker.0 00000100:00100000:0.0:1789892641.298967:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789892641.298968:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789892641.298982:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90308457d500 x1876835055442688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789892641.298992:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876835055442688:0@lo:400:kworker.0 00000100:00100000:1.0:1789892641.298998:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789892641.299000:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055441024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892641.299010:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055441792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892641.299038:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055441536:0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.299039:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055441152 00000100:00100000:3.0:1789892641.299042:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892641.299045:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055441152 00000100:00100000:1.0:1789892641.299057:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055441792:12345-0@lo:400:kworker.0 Request processed in 51us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892641.299066:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055442048:0@lo:400:kworker.0 00000100:00100000:1.0:1789892641.299067:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789892641.299076:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055440896 00000100:00100000:2.0:1789892641.299079:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055440896 00000100:00100000:1.0:1789892641.299090:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055441024 00000100:00100000:0.0:1789892641.299092:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876835055442560:0@lo:400:kworker.0 00000100:00100000:1.0:1789892641.299095:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055441024 00000100:00100000:2.0:1789892641.299101:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789892641.299116:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055441152:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892641.299124:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789892641.299129:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00002000:00000024:2.0:1789892641.299135:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892641.299139:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055440896:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892641.299142:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055441024:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892641.299157:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055441792:0@lo:400:kworker.0 00002000:00000024:3.0:1789892641.299162:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:1.0:1789892641.299176:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:0.0:1789892641.299176:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055442304:0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.299181:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055441152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892641.299192:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789892641.299216:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055441920:0@lo:400:kworker.0 00000100:00100000:3.0:1789892641.299232:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055440896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (266us total) trans 0 rc 0/0 00010000:00080000:0.0:1789892641.299239:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90308457e300 x1876835055442432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892641.299246:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789892641.299247:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055441024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892641.299256:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055441152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892641.299267:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789892641.299273:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876835055442432:0@lo:400:kworker.0 00000100:00100000:2.0:1789892641.299292:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055440896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892641.299308:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055441024:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789892641.873910:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789892642.228481:0:214742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd9141d380 20000000:00000080:1.0:1789892642.228498:0:214742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9031bad36000 uarg=0000000000000000 00000040:00100000:1.0:1789892642.229046:0:214742:0:(llog.c:1072:llog_reverse_process()) index 146 : idx 137 00000040:00100000:1.0:1789892642.229054:0:214742:0:(llog.c:1072:llog_reverse_process()) index 135 : idx 93 20000000:01000000:1.0:1789892642.229057:0:214742:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 135 cmd:0xce021 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:1.0:1789892642.229070:0:214742:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892642.229350:0:214743:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 134 marker 143 1->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892642.229414:0:214743:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 137 marker 143 2->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892642.229448:0:214743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000040:00080000:1.0:1789892642.229599:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].147, 224 off34920 20000000:01000000:1.0:1789892642.229628:0:214742:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892642.229649:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].148, 128 off35048 00000040:00080000:1.0:1789892642.229665:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].149, 224 off35272 20000000:01000000:1.0:1789892642.229675:0:214742:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892642.229979:0:214744:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 157 marker 144 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892642.230002:0:214744:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 144 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892642.230022:0:214744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 169 count 166 00000040:00080000:1.0:1789892642.230125:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].169, 224 off39072 20000000:01000000:1.0:1789892642.230137:0:214742:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892642.230154:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].170, 136 off39208 00000040:00080000:1.0:1789892642.230186:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].171, 224 off39432 20000000:01000000:1.0:1789892642.230216:0:214742:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892642.230500:0:214745:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 157 marker 145 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892642.230523:0:214745:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 145 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892642.230541:0:214745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 169 count 166 00000040:00080000:1.0:1789892642.230622:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].169, 224 off39072 20000000:01000000:1.0:1789892642.230630:0:214742:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892642.230639:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].170, 136 off39208 00000040:00080000:1.0:1789892642.230648:0:214742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].171, 224 off39432 10000000:01000000:1.0:1789892642.230656:0:214742:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892642.230720:0:214742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230741:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230749:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230756:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230762:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230767:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230772:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230777:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230792:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230798:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230803:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230809:0:214742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230814:0:214742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230856:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.230877:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.230890:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055442816:0@lo:104: 00000100:00100000:1.0:1789892642.230959:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892642.231000:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055442816 00000100:00100000:0.0:1789892642.231010:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055442816 00010000:00010000:1.0:1789892642.231013:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.231022:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 23 pid: 190663 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231038:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055442944:0@lo:104: 00000100:00100000:1.0:1789892642.231061:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892642.231067:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789892642.231078:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214742:x1876835055442816:12345-0@lo:104: 00000100:00100000:2.0:1789892642.231090:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055442944 00010000:00010000:0.0:1789892642.231092:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.231096:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231098:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055442944 00010000:00010000:1.0:1789892642.231113:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 23 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231122:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443072:0@lo:104: 00000100:00100000:2.0:1789892642.231153:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789892642.231160:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.231171:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214742:x1876835055442944:12345-0@lo:104: 00010000:00010000:0.0:1789892642.231175:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892642.231183:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055443072 00000100:00100000:0.0:1789892642.231184:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214742:x1876835055442816:12345-0@lo:104: Request processed in 107us (221us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892642.231185:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.231190:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.231206:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055443072 00000100:00100000:0.0:1789892642.231216:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00010000:1.0:1789892642.231227:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 23 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231236:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443200:0@lo:104: 00000100:00100000:0.0:1789892642.231246:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789892642.231256:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214742:x1876835055443072:12345-0@lo:104: 00010000:00010000:0.0:1789892642.231265:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231278:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892642.231285:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892642.231291:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789892642.231296:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214742:x1876835055442944:12345-0@lo:104: Request processed in 129us (231us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892642.231302:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231309:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00010000:1.0:1789892642.231313:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.231314:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892642.231327:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214742:x1876835055443072:12345-0@lo:104: Request processed in 71us (169us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892642.231328:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892642.231334:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892642.231338:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231339:0:194861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789892642.231345:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443328:0@lo:104: 00000100:00100000:2.0:1789892642.231360:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055443200 00000100:00100000:0.0:1789892642.231360:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00010000:00010000:3.0:1789892642.231362:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231367:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055443200 10000000:00010000:3.0:1789892642.231386:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.231391:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892642.231393:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892642.231399:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892642.231402:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892642.231412:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7a00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892642.231415:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231416:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055443328 00000100:00100000:2.0:1789892642.231424:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055443328 00010000:00010000:0.0:1789892642.231425:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.231431:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231451:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 10000000:00010000:0.0:1789892642.231452:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.231462:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231469:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903085a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214742:x1876835055443200:12345-0@lo:104: 10000000:01000000:0.0:1789892642.231473:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892642.231474:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 23 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.231490:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892642.231491:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231495:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f2b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443456:0@lo:104: 00010000:00010000:0.0:1789892642.231499:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.231515:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892642.231520:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.231525:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231532:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892642.231550:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af00f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.231551:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af01d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.231557:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.231575:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892642.231579:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.231581:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.231585:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892642.231590:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:3.0:1789892642.231594:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231607:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903085a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214742:x1876835055443200:12345-0@lo:104: Request processed in 140us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.231609:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443840:0@lo:104: 00010000:00010000:0.0:1789892642.231616:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892642.231634:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892642.231635:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231641:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 10000000:00010000:3.0:1789892642.231642:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231647:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892642.231660:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.231664:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.231669:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.231700:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 23 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892642.231705:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231710:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082130e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443968:0@lo:104: 00000100:00100000:2.0:1789892642.231718:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055443456 10000000:00010000:3.0:1789892642.231720:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892642.231724:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892642.231726:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055443456 10000000:01000000:3.0:1789892642.231735:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892642.231736:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892642.231756:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231758:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055443840 00000100:00100000:2.0:1789892642.231765:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055443840 00010000:00010000:0.0:1789892642.231765:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892642.231773:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.231775:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.231786:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231788:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055443968 00010000:00010000:3.0:1789892642.231791:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892642.231792:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.231795:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055443968 00010000:00010000:0.0:1789892642.231807:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62aeffa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af001 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.231809:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231814:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055444224:0@lo:104: 00000100:00100000:2.0:1789892642.231822:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00010000:00010000:0.0:1789892642.231827:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892642.231830:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892642.231832:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892642.231839:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:214742:x1876835055443328:12345-0@lo:104: 00010000:00010000:3.0:1789892642.231847:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62aefec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aeff3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.231847:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055443712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892642.231854:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231855:0:214742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892642.231882:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.231883:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892642.231888:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892642.231893:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892642.231895:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 9 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.231908:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055444480:192.168.203.53@tcp:104: 00000100:00100000:0.0:1789892642.231915:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.231926:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055443584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892642.231934:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892642.231943:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:214742:x1876835055443328:12345-0@lo:104: Request processed in 109us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.231950:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789892642.231964:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055444224 00000100:00100000:2.0:1789892642.231968:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055444224 00000100:00100000:2.0:1789892642.231988:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789892642.231999:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:214742:x1876835055443456:12345-0@lo:104: 00000100:00100000:3.0:1789892642.232008:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892642.232009:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055444096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892642.232014:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.232033:0:214742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.232043:0:214742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 9 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.232052:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892642.232060:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892642.232060:0:214742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055444608:192.168.203.53@tcp:104: 00010000:00010000:2.0:1789892642.232073:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892642.232075:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.232086:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:214742:x1876835055443456:12345-0@lo:104: Request processed in 87us (556us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892642.232090:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7000 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:0.0:1789892642.232091:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789892642.232095:0:214742:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402840 going to sleep for 11 seconds 10000000:00010000:3.0:1789892642.232096:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.232101:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055444352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892642.232113:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789892642.232121:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055442816:0@lo:104: 00010000:00010000:3.0:1789892642.232122:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892642.232134:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.232134:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892642.232139:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055442944:0@lo:104: 00000100:00100000:2.0:1789892642.232143:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 10000000:01000000:3.0:1789892642.232153:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892642.232162:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443072:0@lo:104: 00000100:00100000:2.0:1789892642.232163:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319dcddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214742:x1876835055443840:12345-0@lo:104: 00000100:00100000:0.0:1789892642.232174:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055443712 00010000:00010000:2.0:1789892642.232176:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232177:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443200:0@lo:104: 00000100:00100000:0.0:1789892642.232180:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055443712 00010000:00010000:3.0:1789892642.232183:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232205:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443328:0@lo:104: 00010000:00010000:3.0:1789892642.232217:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892642.232221:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 24 pid: 190663 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232223:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f2b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443456:0@lo:104: 00010000:00010000:3.0:1789892642.232239:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232247:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443840:0@lo:104: 00010000:00010000:3.0:1789892642.232251:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62aefde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefe5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.232256:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055443584 00010000:00010000:2.0:1789892642.232259:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892642.232261:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055443584 00010000:00010000:3.0:1789892642.232266:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789892642.232271:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319dcddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214742:x1876835055443840:12345-0@lo:104: Request processed in 113us (625us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892642.232273:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.232276:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 25 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.232292:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:3.0:1789892642.232300:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892642.232305:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232314:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.232317:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055444096 00000100:00100000:0.0:1789892642.232322:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055444096 00000100:00100000:1.0:1789892642.232325:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055444352 00000100:00100000:2.0:1789892642.232326:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 10000000:00010000:3.0:1789892642.232327:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232332:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055444352 00010000:00010000:0.0:1789892642.232335:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 26 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.232344:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214742:x1876835055443968:12345-0@lo:104: 00010000:00010000:1.0:1789892642.232353:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 27 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892642.232359:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892642.232363:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.232368:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1789892642.232388:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bdedc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3621:x1876835055443712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892642.232398:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232398:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00010000:00010000:0.0:1789892642.232400:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892642.232409:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 27 pid: 190663 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232412:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892642.232415:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3620:x1876835055443584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892642.232424:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789892642.232427:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.232432:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892642.232432:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 27 pid: 190663 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.232447:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214742:x1876835055443968:12345-0@lo:104: Request processed in 97us (699us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892642.232449:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 27 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232464:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62aefd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefd7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.232474:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00010000:00010000:0.0:1789892642.232474:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af00f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af008 expref: 27 pid: 190663 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.232478:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 27 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232492:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892642.232500:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.232501:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00010000:00010000:0.0:1789892642.232507:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892642.232508:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9c600/0xd5b980e0d62af01d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af016 expref: 26 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.232519:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214742:x1876835055444224:12345-0@lo:104: 00010000:00010000:3.0:1789892642.232521:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6a00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892642.232526:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1789892642.232529:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232534:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232541:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.232546:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bdedc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3621:x1876835055443712:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.232561:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 10000000:00010000:3.0:1789892642.232562:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232564:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055443584:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (561us total) trans 0 rc 0/0 10000000:01000000:3.0:1789892642.232580:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892642.232580:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00010000:00010000:2.0:1789892642.232590:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892642.232599:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214742:x1876835055444224:12345-0@lo:104: Request processed in 85us (748us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892642.232604:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232606:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1789892642.232630:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1789892642.232634:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3618:x1876835055444096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892642.232635:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892642.232640:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00010000:00010000:1.0:1789892642.232646:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892642.232648:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3618:x1876835055444352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892642.232653:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 23 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.232662:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892642.232663:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 23 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232665:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232671:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892642.232673:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 23 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.232708:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383200/0xd5b980e0d62af001 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aeffa expref: 23 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232720:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232733:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62aefc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefc9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.232738:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 23 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232740:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7c00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892642.232748:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232768:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232769:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892642.232771:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892642.232772:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383400/0xd5b980e0d62aeff3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aefec expref: 22 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232778:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892642.232795:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232797:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055444096:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (749us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892642.232798:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892642.232801:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6e00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892642.232809:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232818:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 10000000:01000000:2.0:1789892642.232821:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892642.232831:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055444352:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (698us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892642.232834:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.232841:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 10000000:00010000:3.0:1789892642.232853:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232854:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.232860:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082130e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055443968:0@lo:104: 00000100:00100000:1.0:1789892642.232876:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055444224:0@lo:104: 10000000:01000000:3.0:1789892642.232877:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892642.232878:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892642.232893:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232898:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62aefb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefbb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232904:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232912:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892642.232914:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892642.232916:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892642.232919:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892642.232924:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.232928:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892642.232934:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62aefa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62aefad expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.232970:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892642.232973:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892642.232975:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892642.232987:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892642.232991:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055444736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892642.233003:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055445120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892642.233016:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892642.233034:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892642.233052:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055444992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892642.233059:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055444736 00000100:00100000:1.0:1789892642.233064:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055444736 00010000:00010000:1.0:1789892642.233083:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 20 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.233089:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055445248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892642.233093:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.233105:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055444864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892642.233119:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055444992 00000100:00100000:1.0:1789892642.233122:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055444992 00010000:00010000:1.0:1789892642.233137:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 21 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.233144:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055444352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892642.233147:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.233159:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892642.233166:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055445248 00000100:00100000:0.0:1789892642.233170:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055444096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892642.233171:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055445248 00010000:00010000:1.0:1789892642.233188:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 22 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.233213:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055443584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892642.233216:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055444864 00000100:00100000:1.0:1789892642.233221:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055444864 00000100:00100000:3.0:1789892642.233226:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055443712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892642.233237:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 23 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.233239:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789892642.233256:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055444736:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892642.233259:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789892642.233270:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3618:x1876835055444992:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892642.233275:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00010000:00010000:0.0:1789892642.233276:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892642.233288:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.233292:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055445248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892642.233292:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892642.233301:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.233310:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892642.233314:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.233322:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.233332:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.233346:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d000/0xd5b980e0d62aefe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aefde expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.233350:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 23 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.233374:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892642.233376:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9de00/0xd5b980e0d62aefc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aefc2 expref: 22 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.233383:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62aefad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aefa6 expref: 22 pid: 190664 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.233389:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892642.233398:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892642.233437:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055444736:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.233447:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1789892642.233449:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055444736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892642.233453:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055444992:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.233465:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055445248:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.233465:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1789892642.233472:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055445248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892642.233479:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789892642.233489:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789892642.233493:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3621:x1876835055444864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892642.233501:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892642.233505:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 17 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.233514:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 17 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.233523:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382600/0xd5b980e0d62aefd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aefd0 expref: 17 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.233532:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892642.233564:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3621:x1876835055444864:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.233573:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.233582:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055444864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892642.233584:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789892642.233605:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055445120 00000100:00100000:1.0:1789892642.233609:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055445120 00010000:00010000:1.0:1789892642.233625:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 16 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.233630:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055444992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892642.233651:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789892642.233660:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bdede450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055445120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892642.233666:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892642.233669:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 16 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.233675:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 16 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.233703:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383000/0xd5b980e0d62aefbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62aefb4 expref: 16 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.233716:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892642.233742:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bdede450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055445120:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.233747:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1789892642.233759:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055445120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892642.234045:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055444480:192.168.203.53@tcp:104: 00000100:00100000:1.0:1789892642.234051:0:214742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214742:1876835055444608:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892642.234081:0:214742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.234323:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892642.234372:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062727424 00000100:00100000:0.0:1789892642.234378:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062727424 00000100:00100000:3.0:1789892642.234396:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:0.0:1789892642.234400:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 10 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.234425:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062727552 00000100:00100000:0.0:1789892642.234427:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062727552 00000100:00100000:1.0:1789892642.234437:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 433 00010000:00010000:0.0:1789892642.234438:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 11 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.234449:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062727424:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892642.234457:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892642.234461:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 434 00010000:00010000:1.0:1789892642.234466:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 11 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.234474:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062727552:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892642.234479:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 11 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234484:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892642.234491:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 11 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.234492:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98200/0xd5b980e0d62aef98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260336 expref: 11 pid: 194990 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234512:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 10 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.234519:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892642.234525:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62aef9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26033d expref: 10 pid: 190662 timeout: 3432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234541:0:202163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234548:0:202163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892642.234550:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2396:x1876835062727424:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 105us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.234562:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 433 00010000:00010000:0.0:1789892642.234571:0:202163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234578:0:202163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234583:0:202163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234588:0:202163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234591:0:202163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6000 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:0.0:1789892642.234595:0:202163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234601:0:202163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234612:0:202163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.234619:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892642.234625:0:214742:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.234639:0:214742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.234644:0:214742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af024 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.234652:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2397:x1876835062727552:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 180us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.234662:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 434 10000000:01000000:2.0:1789892642.601788:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892642.601799:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 147 10000000:01000000:2.0:1789892642.601805:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892642.601868:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.601897:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.601910:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.601938:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055445376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.602023:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.602093:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.602107:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055445376 00000100:00100000:1.0:1789892642.602125:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055445376 00000100:00100000:1.0:1789892642.602202:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:1.0:1789892642.602212:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055445376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892642.602227:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892642.602242:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af02b expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.602267:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 16 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.602277:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 16 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.602286:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6000, rc 0) 00000100:00100000:1.0:1789892642.602330:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055445376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.602338:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1789892642.602374:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055445376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892642.602391:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.602403:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.602465:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055445504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.602487:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.602505:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.602533:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055445504 00000100:00100000:1.0:1789892642.602539:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055445504 00000100:00100000:1.0:1789892642.602566:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:1.0:1789892642.602571:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055445504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892642.602723:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055445504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.602732:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:2.0:1789892642.602758:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055445504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.602790:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055445632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.602827:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.602846:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1000 going to sleep for 11 seconds 00000100:00100000:3.0:1789892642.602874:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055445632 00000100:00100000:3.0:1789892642.602880:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055445632 00000100:00100000:3.0:1789892642.602915:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:3.0:1789892642.602925:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055445632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.603027:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055445632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.603037:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:2.0:1789892642.603045:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055445632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.603438:0:214746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214746:1876835055445760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.603479:0:214746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.603501:0:214746:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892642.603527:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055445760 00000100:00100000:0.0:1789892642.603532:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055445760 00000100:00100000:0.0:1789892642.603563:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1789892642.603569:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214746:x1876835055445760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892642.603667:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214746:x1876835055445760:12345-0@lo:502:llog_process_th.0 Request processed in 98us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.603674:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:2.0:1789892642.603717:0:214746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214746:1876835055445760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.603773:0:214746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214746:1876835055445888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.603830:0:214746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.603850:0:214746:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.603863:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055445888 00000100:00100000:1.0:1789892642.603870:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055445888 00000100:00100000:1.0:1789892642.603908:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:1.0:1789892642.603918:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214746:x1876835055445888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.604014:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214746:x1876835055445888:12345-0@lo:502:llog_process_th.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.604023:0:214746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214746:1876835055445888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.604027:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000040:00080000:2.0:1789892642.604044:0:214746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:3.0:1789892642.604129:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:3.0:1789892642.604153:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892642.604162:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.604180:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892642.604204:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892642.604207:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:3.0:1789892642.604210:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892642.604230:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.604238:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.604247:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.604262:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.604293:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.604311:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030810bfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.604343:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055446016 00000100:00100000:1.0:1789892642.604349:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055446016 00000100:00100000:1.0:1789892642.604382:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:1.0:1789892642.604392:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055446016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892642.604401:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892642.604412:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af039 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.604430:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.604441:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.604450:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7800, rc 0) 00000100:00100000:1.0:1789892642.604487:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055446016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.604507:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:3.0:1789892642.604523:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892642.604537:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.604548:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.604593:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.604618:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.604645:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030810bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892642.604670:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055446144 00000100:00100000:2.0:1789892642.604676:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055446144 00000100:00100000:2.0:1789892642.604744:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:2.0:1789892642.604753:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055446144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.604833:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055446144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.604839:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00100000:3.0:1789892642.604870:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.604898:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.604934:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.604957:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030810bfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892642.605006:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055446272 00000100:00100000:0.0:1789892642.605011:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055446272 00000100:00100000:0.0:1789892642.605038:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:0.0:1789892642.605044:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055446272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.605136:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055446272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.605146:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1789892642.605166:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892642.605945:0:214747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:2.0:1789892642.606045:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:2.0:1789892642.606059:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892642.606064:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.606072:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892642.606078:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892642.606079:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 147 10000000:01000000:2.0:1789892642.606081:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892642.606100:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.606106:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.606112:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.606123:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.606157:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.606185:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.606227:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055446400 00000100:00100000:1.0:1789892642.606245:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055446400 00000100:00100000:1.0:1789892642.606276:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:1.0:1789892642.606284:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055446400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892642.606293:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892642.606301:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af047 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.606313:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 18 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.606319:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 18 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.606325:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7200, rc 0) 00000100:00100000:1.0:1789892642.606353:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055446400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.606359:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:2.0:1789892642.606372:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892642.606383:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.606391:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.606421:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.606441:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.606456:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.606477:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055446528 00000100:00100000:1.0:1789892642.606481:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055446528 00000100:00100000:1.0:1789892642.606502:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:1.0:1789892642.606507:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055446528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892642.606564:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055446528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.606570:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:2.0:1789892642.606589:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.606615:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.606646:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.606660:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892642.606709:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055446656 00000100:00100000:3.0:1789892642.606715:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055446656 00000100:00100000:3.0:1789892642.606742:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:3.0:1789892642.606750:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055446656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.606820:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055446656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.606830:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:2.0:1789892642.606847:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055446656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.607064:0:214748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214748:1876835055446784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.607113:0:214748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.607141:0:214748:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892642.607169:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055446784 00000100:00100000:0.0:1789892642.607181:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055446784 00000100:00100000:0.0:1789892642.607227:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1789892642.607236:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214748:x1876835055446784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892642.607315:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214748:x1876835055446784:12345-0@lo:502:llog_process_th.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.607322:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:2.0:1789892642.607331:0:214748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214748:1876835055446784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.607365:0:214748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214748:1876835055446912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.607394:0:214748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.607408:0:214748:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.607441:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055446912 00000100:00100000:1.0:1789892642.607454:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055446912 00000100:00100000:1.0:1789892642.607488:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:1.0:1789892642.607497:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214748:x1876835055446912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.607580:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214748:x1876835055446912:12345-0@lo:502:llog_process_th.0 Request processed in 84us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.607588:0:214748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214748:1876835055446912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.607592:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000040:00080000:2.0:1789892642.607609:0:214748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:3.0:1789892642.607661:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:3.0:1789892642.607705:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892642.607713:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.607723:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892642.607730:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892642.607733:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:3.0:1789892642.607736:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892642.607750:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.607769:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.607778:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.607793:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.607821:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.607845:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319cc97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.607872:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055447040 00000100:00100000:1.0:1789892642.607878:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055447040 00000100:00100000:1.0:1789892642.607910:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:1.0:1789892642.607919:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055447040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892642.607928:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892642.607939:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af055 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.607954:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 19 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.607964:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 19 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.607972:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892642.608010:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055447040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.608019:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:3.0:1789892642.608026:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892642.608041:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.608051:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.608088:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.608113:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.608133:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319cc97e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892642.608157:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055447168 00000100:00100000:2.0:1789892642.608161:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055447168 00000100:00100000:2.0:1789892642.608189:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:2.0:1789892642.608207:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055447168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.608270:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055447168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.608277:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:3.0:1789892642.608290:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.608316:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.608353:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.608376:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319cc97e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892642.608410:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055447296 00000100:00100000:0.0:1789892642.608416:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055447296 00000100:00100000:0.0:1789892642.608448:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:0.0:1789892642.608457:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055447296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.608545:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055447296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.608554:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1789892642.608556:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892642.609273:0:214749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:2.0:1789892642.609330:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:2.0:1789892642.609351:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892642.609356:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.609364:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892642.609369:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892642.609377:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 147 10000000:01000000:2.0:1789892642.609379:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892642.609391:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.609397:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.609402:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.609411:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.609432:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.609451:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.609478:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055447424 00000100:00100000:1.0:1789892642.609483:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055447424 00000100:00100000:1.0:1789892642.609506:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:1.0:1789892642.609511:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055447424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892642.609524:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892642.609531:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af063 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.609543:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 20 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.609549:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 20 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.609554:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7400, rc 0) 00000100:00100000:1.0:1789892642.609580:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055447424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.609585:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1789892642.609605:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892642.609617:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.609623:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.609652:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.609672:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892642.609701:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055447552 00000100:00100000:1.0:1789892642.609705:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055447552 00000100:00100000:2.0:1789892642.609711:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.609736:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:1.0:1789892642.609742:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055447552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892642.609798:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055447552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.609805:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:2.0:1789892642.609812:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.609836:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.609868:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.609892:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892642.609908:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055447680 00000100:00100000:3.0:1789892642.609914:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055447680 00000100:00100000:3.0:1789892642.609942:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:3.0:1789892642.609951:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055447680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.610018:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055447680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.610026:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:2.0:1789892642.610045:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055447680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.610231:0:214750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214750:1876835055447808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.610258:0:214750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.610272:0:214750:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892642.610305:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055447808 00000100:00100000:0.0:1789892642.610310:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055447808 00000100:00100000:0.0:1789892642.610343:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:0.0:1789892642.610348:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214750:x1876835055447808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892642.610419:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214750:x1876835055447808:12345-0@lo:502:llog_process_th.0 Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.610425:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:2.0:1789892642.610429:0:214750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214750:1876835055447808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.610464:0:214750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214750:1876835055447936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.610490:0:214750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.610503:0:214750:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.610515:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055447936 00000100:00100000:1.0:1789892642.610519:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055447936 00000100:00100000:1.0:1789892642.610540:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:1.0:1789892642.610545:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214750:x1876835055447936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.610601:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214750:x1876835055447936:12345-0@lo:502:llog_process_th.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.610614:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:2.0:1789892642.610618:0:214750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214750:1876835055447936:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892642.610640:0:214750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:3.0:1789892642.610713:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:3.0:1789892642.610735:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892642.610742:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.610751:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892642.610759:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892642.610761:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 169 10000000:01000000:3.0:1789892642.610764:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892642.610779:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.610787:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.610795:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.610812:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.610840:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.610873:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319c9e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.610886:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055448064 00000100:00100000:1.0:1789892642.610891:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055448064 00000100:00100000:1.0:1789892642.610923:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:1.0:1789892642.610931:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055448064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892642.610940:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892642.610950:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af071 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.610967:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 21 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.610976:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 21 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.610984:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6400, rc 0) 00000100:00100000:1.0:1789892642.611021:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055448064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.611029:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00100000:3.0:1789892642.611037:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892642.611051:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.611061:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.611098:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.611124:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.611141:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319c9e13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892642.611155:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055448192 00000100:00100000:2.0:1789892642.611159:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055448192 00000100:00100000:2.0:1789892642.611180:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:2.0:1789892642.611185:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055448192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.611256:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055448192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.611263:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:3.0:1789892642.611274:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.611301:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.611337:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.611356:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319c9e13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892642.611374:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055448320 00000100:00100000:0.0:1789892642.611379:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055448320 00000100:00100000:0.0:1789892642.611402:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:0.0:1789892642.611408:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055448320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.611495:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055448320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.611497:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.611507:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:3.0:1789892642.611718:0:214751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214751:1876835055448448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892642.611756:0:214751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892642.611786:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055448448 00000100:00100000:3.0:1789892642.611788:0:214751:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319c9e1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.611791:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055448448 00000100:00100000:1.0:1789892642.611818:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:1.0:1789892642.611823:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214751:x1876835055448448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.611895:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214751:x1876835055448448:12345-0@lo:502:llog_process_th.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.611901:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:3.0:1789892642.611914:0:214751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214751:1876835055448448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892642.611941:0:214751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892642.611953:0:214751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892642.611956:0:214751:0:(obd_config.c:1561:class_process_config()) marker 157 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:3.0:1789892642.611961:0:214751:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789892642.611982:0:214751:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000100:00100000:3.0:1789892642.612000:0:214751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214751:1876835055448576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892642.612037:0:214751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.612056:0:214751:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.612060:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055448576 00000100:00100000:1.0:1789892642.612069:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055448576 00000100:00100000:1.0:1789892642.612091:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1789892642.612095:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214751:x1876835055448576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.612151:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214751:x1876835055448576:12345-0@lo:502:llog_process_th.0 Request processed in 54us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.612158:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:3.0:1789892642.612173:0:214751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214751:1876835055448576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892642.612210:0:214751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892642.612214:0:214751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892642.612216:0:214751:0:(obd_config.c:1561:class_process_config()) marker 157 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:3.0:1789892642.612220:0:214751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 172 count 169 00000020:01000000:2.0:1789892642.612268:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 169-171 (rc=0) 10000000:01000000:2.0:1789892642.612289:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892642.612294:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.612301:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892642.612317:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892642.612319:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 147 10000000:01000000:2.0:1789892642.612321:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892642.612332:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.612338:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.612343:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.612352:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.612372:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.612386:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892642.612398:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055448704 00000100:00100000:3.0:1789892642.612404:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055448704 00000100:00100000:3.0:1789892642.612432:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:3.0:1789892642.612439:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055448704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892642.612447:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892642.612456:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af07f expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.612472:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 22 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.612481:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 22 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.612489:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d800, rc 0) 00000100:00100000:3.0:1789892642.612523:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055448704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.612531:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00100000:2.0:1789892642.612552:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892642.612565:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.612573:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.612601:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.612621:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.612635:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892642.612658:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055448832 00000100:00100000:0.0:1789892642.612663:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055448832 00000100:00100000:0.0:1789892642.612712:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:0.0:1789892642.612720:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055448832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.612800:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055448832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892642.612808:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:2.0:1789892642.612823:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.612856:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.612885:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.612911:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.612931:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055448960 00000100:00100000:1.0:1789892642.612938:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055448960 00000100:00100000:1.0:1789892642.612969:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:1.0:1789892642.612977:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055448960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892642.613039:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055448960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.613046:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:2.0:1789892642.613054:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055448960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892642.613249:0:214752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214752:1876835055449088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.613275:0:214752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.613288:0:214752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031988083c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.613309:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055449088 00000100:00100000:1.0:1789892642.613314:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055449088 00000100:00100000:1.0:1789892642.613335:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:1.0:1789892642.613340:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214752:x1876835055449088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.613415:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214752:x1876835055449088:12345-0@lo:502:llog_process_th.0 Request processed in 71us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.613421:0:214752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214752:1876835055449088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892642.613426:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:2.0:1789892642.613456:0:214752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214752:1876835055449216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.613485:0:214752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.613498:0:214752:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892642.613517:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055449216 00000100:00100000:3.0:1789892642.613523:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055449216 00000100:00100000:3.0:1789892642.613550:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:3.0:1789892642.613565:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214752:x1876835055449216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892642.613639:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214752:x1876835055449216:12345-0@lo:502:llog_process_th.0 Request processed in 75us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.613648:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00100000:2.0:1789892642.613651:0:214752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214752:1876835055449216:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892642.613675:0:214752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:0.0:1789892642.613771:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:0.0:1789892642.613792:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892642.613799:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.613810:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892642.613832:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892642.613834:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 169 10000000:01000000:0.0:1789892642.613837:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892642.613853:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.613862:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.613870:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.613884:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055449344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.613913:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892642.613940:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055449344 00000100:00100000:2.0:1789892642.613944:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055449344 00000100:00100000:0.0:1789892642.613947:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a733c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892642.613974:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:2.0:1789892642.613979:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055449344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892642.613985:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892642.613992:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af08d expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.614004:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.614011:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892642.614022:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382e00, rc 0) 00000100:00100000:2.0:1789892642.614048:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055449344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.614054:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:0.0:1789892642.614090:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055449344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892642.614103:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892642.614113:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892642.614162:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055449472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.614205:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892642.614226:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a733c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.614252:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055449472 00000100:00100000:1.0:1789892642.614258:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055449472 00000100:00100000:1.0:1789892642.614286:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:1.0:1789892642.614291:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055449472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892642.614350:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055449472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.614364:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:0.0:1789892642.614392:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055449472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.614432:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055449600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.614461:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892642.614477:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a733c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.614496:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055449600 00000100:00100000:1.0:1789892642.614500:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055449600 00000100:00100000:1.0:1789892642.614521:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:1.0:1789892642.614525:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055449600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892642.614583:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055449600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892642.614589:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:0.0:1789892642.614622:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055449600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892642.614852:0:214753:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214753:1876835055449728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892642.614881:0:214753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892642.614902:0:214753:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a73540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892642.614912:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055449728 00000100:00100000:3.0:1789892642.614918:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055449728 00000100:00100000:3.0:1789892642.614948:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:3.0:1789892642.614954:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214753:x1876835055449728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892642.615046:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214753:x1876835055449728:12345-0@lo:502:llog_process_th.0 Request processed in 91us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.615055:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:0.0:1789892642.615069:0:214753:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214753:1876835055449728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892642.615090:0:214753:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892642.615096:0:214753:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892642.615097:0:214753:0:(obd_config.c:1561:class_process_config()) marker 156 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:0.0:1789892642.615102:0:214753:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1789892642.615110:0:214753:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000020:01000004:3.0:1789892642.615462:0:214754:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789892642.615467:0:214754:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:0.0:1789892642.615478:0:214753:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214753:1876835055449856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892642.615522:0:214753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892642.615544:0:214753:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a73540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892642.615562:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055449856 00000100:00100000:2.0:1789892642.615567:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055449856 00000100:00100000:2.0:1789892642.615593:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:2.0:1789892642.615598:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214753:x1876835055449856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892642.615660:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214753:x1876835055449856:12345-0@lo:502:llog_process_th.0 Request processed in 61us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892642.615667:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1789892642.615713:0:214753:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214753:1876835055449856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892642.615738:0:214753:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892642.615743:0:214753:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892642.615745:0:214753:0:(obd_config.c:1561:class_process_config()) marker 156 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789892642.615749:0:214753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 172 count 169 00000020:01000000:3.0:1789892642.615802:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 169-171 (rc=0) 10000000:01000000:3.0:1789892642.615826:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892642.615833:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.615843:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892642.615851:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892642.615853:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:3.0:1789892642.615856:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892642.615870:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.615879:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.615894:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.615908:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055449984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.615935:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.615960:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.615984:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055449984 00000100:00100000:1.0:1789892642.615990:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055449984 00000100:00100000:1.0:1789892642.616026:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:1.0:1789892642.616035:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055449984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892642.616043:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892642.616054:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af09b expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.616071:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 24 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.616082:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 24 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892642.616090:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6c00, rc 0) 00000100:00100000:1.0:1789892642.616128:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055449984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.616138:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055449984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892642.616138:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00010000:00010000:3.0:1789892642.616155:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.616165:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892642.616219:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055450112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892642.616245:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.616262:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892642.616294:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055450112 00000100:00100000:1.0:1789892642.616307:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055450112 00000100:00100000:1.0:1789892642.616340:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:1.0:1789892642.616349:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055450112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892642.616412:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055450112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (165us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892642.616421:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1789892642.616440:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055450112:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789892642.616466:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892642.616471:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892642.616480:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892642.833905:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789892642.833934:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055450240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892642.834024:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892642.834082:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055450240 00000100:00100000:3.0:1789892642.834110:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055450240 00000100:00100000:3.0:1789892642.834169:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789892642.834179:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055450240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789892642.834241:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892642.834312:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055450240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892642.834319:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789892642.834359:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055450240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789892642.897844:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892643.516023:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892643.516075:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062727680 00000100:00100000:3.0:1789892643.516082:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892643.516091:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062727680 00000100:00100000:3.0:1789892643.516141:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892643.516158:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1862 00000100:00100000:2.0:1789892643.516171:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2396:x1876835062727680:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892643.516211:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062727808 00000100:00100000:1.0:1789892643.516223:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062727808 00000100:00080000:3.0:1789892643.516263:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892643.516270:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2396:x1876835062727680:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 101us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.516276:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1862 00000100:00100000:1.0:1789892643.516290:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062727936 00000100:00100000:1.0:1789892643.516295:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062727936 00000100:00080000:2.0:1789892643.516322:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892643.516344:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 448 00000100:00100000:1.0:1789892643.516353:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2397:x1876835062727808:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1789892643.516366:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 449 00000100:00100000:2.0:1789892643.516377:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2396:x1876835062727936:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892643.516404:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2397:x1876835062727808:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 43us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.516412:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 448 00000100:00100000:2.0:1789892643.516427:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2396:x1876835062727936:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 51us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.516435:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 449 00000020:00000080:3.0:1789892643.800434:0:214852:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc0b748180 20000000:00000080:3.0:1789892643.800452:0:214852:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90309214cc00 uarg=0000000000000000 00000040:00100000:3.0:1789892643.801017:0:214852:0:(llog.c:1072:llog_reverse_process()) index 149 : idx 137 20000000:01000000:3.0:1789892643.801024:0:214852:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 148 cmd:0xce022 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:3.0:1789892643.801037:0:214852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892643.801289:0:214853:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 128 marker 137 1->4: lustre-clilov new lustre.qpool1 20000000:01000000:3.0:1789892643.801344:0:214853:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 130 marker 137 2->4: lustre-clilov new lustre.qpool1 00000040:00080000:3.0:1789892643.801365:0:214853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000040:00080000:1.0:1789892643.801493:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].150, 224 off35496 20000000:01000000:1.0:1789892643.801510:0:214852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789892643.801522:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].151, 104 off35600 00000040:00080000:1.0:1789892643.801541:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].152, 224 off35824 20000000:01000000:1.0:1789892643.801558:0:214852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892643.801838:0:214854:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 151 marker 138 1->4: lustre-MDT0000-mdtlov new lustre.qpool1 20000000:01000000:3.0:1789892643.801854:0:214854:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 153 marker 138 2->4: lustre-MDT0000-mdtlov new lustre.qpool1 00000040:00080000:3.0:1789892643.801872:0:214854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 172 count 169 00000040:00080000:0.0:1789892643.801971:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].172, 224 off39656 20000000:01000000:0.0:1789892643.801986:0:214852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892643.801997:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].173, 112 off39768 00000040:00080000:0.0:1789892643.802007:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].174, 224 off39992 20000000:01000000:0.0:1789892643.802017:0:214852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892643.802241:0:214855:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 151 marker 139 1->4: lustre-MDT0001-mdtlov new lustre.qpool1 20000000:01000000:3.0:1789892643.802258:0:214855:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 153 marker 139 2->4: lustre-MDT0001-mdtlov new lustre.qpool1 00000040:00080000:3.0:1789892643.802269:0:214855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 172 count 169 00000040:00080000:0.0:1789892643.802342:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].172, 224 off39656 20000000:01000000:0.0:1789892643.802350:0:214852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892643.802359:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].173, 112 off39768 00000040:00080000:0.0:1789892643.802369:0:214852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].174, 224 off39992 10000000:01000000:0.0:1789892643.802377:0:214852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789892643.802398:0:214852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802417:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802424:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802428:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802432:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802437:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802441:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802445:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802450:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802463:0:214852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802468:0:214852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802511:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802523:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 23 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.802537:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450368:0@lo:104: 00000100:00100000:0.0:1789892643.802607:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892643.802655:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055450368 00010000:00010000:0.0:1789892643.802664:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.802666:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055450368 00010000:00010000:0.0:1789892643.802675:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 23 pid: 194990 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.802701:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450496:0@lo:104: 00000100:00100000:0.0:1789892643.802734:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892643.802758:0:194861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789892643.802771:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055450496 00000100:00100000:2.0:1789892643.802775:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055450496 00010000:00010000:0.0:1789892643.802778:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.802783:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00010000:00010000:0.0:1789892643.802792:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 23 pid: 190664 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.802800:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055450368:12345-0@lo:104: 00000100:00100000:0.0:1789892643.802803:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450624:0@lo:104: 00000100:00100000:2.0:1789892643.802807:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00010000:00010000:1.0:1789892643.802818:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.802821:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ca56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055450496:12345-0@lo:104: 00010000:00010000:2.0:1789892643.802835:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.802836:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.802857:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055450624 00000100:00100000:3.0:1789892643.802863:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055450624 00010000:00010000:0.0:1789892643.802870:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.802881:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 23 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.802889:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450752:0@lo:104: 00000100:00100000:3.0:1789892643.802894:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00010000:00010000:1.0:1789892643.802900:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892643.802907:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214852:x1876835055450368:12345-0@lo:104: Request processed in 112us (299us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892643.802908:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892643.802917:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214852:x1876835055450624:12345-0@lo:104: 00000100:00100000:0.0:1789892643.802919:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892643.802920:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ca56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214852:x1876835055450496:12345-0@lo:104: Request processed in 101us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892643.802939:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.802940:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.802940:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789892643.802952:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789892643.802958:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055450752 00000100:00100000:2.0:1789892643.802963:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055450752 00010000:00010000:0.0:1789892643.802963:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 23 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.802974:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450880:0@lo:104: 00000100:00100000:2.0:1789892643.802989:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1789892643.802999:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055450752:12345-0@lo:104: 00010000:00010000:2.0:1789892643.803006:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.803007:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892643.803013:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789892643.803021:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055450624:12345-0@lo:104: Request processed in 119us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892643.803030:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00010000:00010000:1.0:1789892643.803031:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789892643.803039:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.803042:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803049:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055450880 00000100:00100000:3.0:1789892643.803054:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055450880 00010000:00010000:1.0:1789892643.803057:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c200 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892643.803062:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789892643.803063:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 23 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892643.803064:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803074:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789892643.803077:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055450752:12345-0@lo:104: Request processed in 76us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892643.803087:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055450880:12345-0@lo:104: 00010000:00010000:1.0:1789892643.803088:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.803098:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055451008:0@lo:104: 00010000:00010000:3.0:1789892643.803102:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.803111:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 10000000:00010000:1.0:1789892643.803114:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892643.803123:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892643.803142:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892643.803143:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892643.803157:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1789892643.803160:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803163:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803165:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214852:x1876835055450880:12345-0@lo:104: Request processed in 79us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892643.803194:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803196:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99000 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892643.803196:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892643.803201:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 10000000:00010000:2.0:1789892643.803207:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.803214:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 23 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803217:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803221:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055451008 10000000:00010000:2.0:1789892643.803224:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803232:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892643.803245:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892643.803249:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af09b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0a2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.803250:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055451264:0@lo:104: 00010000:00010000:2.0:1789892643.803263:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803266:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892643.803270:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892643.803272:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803281:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.803281:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892643.803301:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af08d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af094 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803303:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382000 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892643.803306:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892643.803309:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803324:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892643.803331:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.803331:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 23 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803333:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803341:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055451008 10000000:00010000:1.0:1789892643.803356:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.803357:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055451520:0@lo:104: 00000100:00100000:3.0:1789892643.803361:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055451264 00000100:00100000:3.0:1789892643.803367:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055451264 00010000:00010000:2.0:1789892643.803375:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c800 already unused, calling callback (ffffffffc130dc20) 10000000:01000000:1.0:1789892643.803375:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1789892643.803381:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803390:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803394:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1789892643.803397:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892643.803399:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803409:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055451008:12345-0@lo:104: 10000000:00010000:2.0:1789892643.803411:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803412:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1789892643.803422:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892643.803424:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.803430:0:214852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803433:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803443:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803453:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af07f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af086 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803456:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892643.803456:0:214852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 23 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.803457:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892643.803466:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803471:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892643.803475:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055451008:12345-0@lo:104: Request processed in 67us (332us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892643.803479:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.803489:0:214852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055451776:0@lo:104: 00010000:00010000:2.0:1789892643.803491:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af078 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803497:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00010000:1.0:1789892643.803502:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892643.803507:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803512:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892643.803516:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803517:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055451520 00000100:00100000:3.0:1789892643.803524:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055451520 00000100:00100000:0.0:1789892643.803537:0:214852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892643.803538:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9ce00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892643.803540:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892643.803544:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892643.803549:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803551:0:190654:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:01000000:1.0:1789892643.803561:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892643.803562:0:214852:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789892643.803567:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803569:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055451776 00000100:00100000:3.0:1789892643.803574:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055451776 10000000:00010000:2.0:1789892643.803576:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892643.803581:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892643.803586:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803591:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892643.803596:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450368:0@lo:104: 00000100:00100000:3.0:1789892643.803597:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00010000:00010000:1.0:1789892643.803598:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803601:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803607:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214852:x1876835055451264:12345-0@lo:104: 00000100:00100000:0.0:1789892643.803620:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450496:0@lo:104: 00010000:00010000:3.0:1789892643.803622:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803623:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892643.803623:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af063 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af06a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803635:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.803637:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450624:0@lo:104: 00010000:00010000:2.0:1789892643.803653:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9ce00/0xd5b980e0d62af055 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af05c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.803653:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892643.803658:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892643.803659:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450752:0@lo:104: 00010000:00010000:1.0:1789892643.803663:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892643.803699:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892643.803700:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892643.803701:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055450880:0@lo:104: 00010000:00010000:3.0:1789892643.803704:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:2.0:1789892643.803706:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803714:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:214852:x1876835055451264:12345-0@lo:104: Request processed in 109us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.803716:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055451136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892643.803717:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382800 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:0.0:1789892643.803717:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055451008:0@lo:104: 10000000:00010000:2.0:1789892643.803724:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803729:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789892643.803734:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055451264:0@lo:104: 00010000:00010000:2.0:1789892643.803737:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803749:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 10000000:00010000:2.0:1789892643.803752:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803758:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055451520:12345-0@lo:104: 00000100:00100000:1.0:1789892643.803765:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892643.803772:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892643.803773:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892643.803782:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789892643.803795:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903085a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055451776:12345-0@lo:104: 00010000:00010000:2.0:1789892643.803798:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803804:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892643.803805:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.803807:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055452032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892643.803813:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.803822:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892643.803830:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af04e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.803831:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:214852:x1876835055451520:12345-0@lo:104: Request processed in 74us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.803846:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.803850:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00010000:00010000:2.0:1789892643.803856:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892643.803859:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803864:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d200 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892643.803866:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789892643.803867:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.803871:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892643.803877:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789892643.803878:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903085a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:214852:x1876835055451776:12345-0@lo:104: Request processed in 84us (347us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892643.803882:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803882:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.803886:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055451392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892643.803890:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 10000000:00010000:2.0:1789892643.803899:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.803903:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382a00 already unused, calling callback (ffffffffc130dc20) 10000000:01000000:2.0:1789892643.803904:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1789892643.803907:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.803915:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892643.803921:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803923:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.803924:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789892643.803942:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892643.803942:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892643.803948:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055451520:0@lo:104: 00010000:00010000:2.0:1789892643.803955:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.803957:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055452160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892643.803964:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.803964:0:214852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214852:1876835055451776:0@lo:104: 00010000:00010000:2.0:1789892643.803971:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af040 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.803983:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892643.803992:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892643.803994:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892643.803996:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.803998:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892643.804003:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892643.804004:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af02b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af032 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.804015:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892643.804024:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055452544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892643.804026:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892643.804030:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892643.804033:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892643.804033:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055451648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892643.804035:0:214852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.804048:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.804066:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055451136 00000100:00100000:3.0:1789892643.804072:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055451136 00000100:00100000:2.0:1789892643.804072:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.804086:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055452032 00010000:00010000:3.0:1789892643.804094:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 24 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.804094:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055451392 00000100:00100000:0.0:1789892643.804094:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055452032 00000100:00100000:2.0:1789892643.804100:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055452288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892643.804102:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055451392 00010000:00010000:0.0:1789892643.804120:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 26 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.804123:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055452160 00010000:00010000:1.0:1789892643.804127:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 26 pid: 194990 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804133:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.804134:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055452160 00000100:00100000:0.0:1789892643.804143:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055452544 00000100:00100000:0.0:1789892643.804148:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055452544 00010000:00010000:3.0:1789892643.804152:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 28 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.804154:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055451648 00000100:00100000:2.0:1789892643.804156:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789892643.804161:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055451648 00010000:00010000:0.0:1789892643.804163:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 28 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804167:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055451904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892643.804176:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055452288 00010000:00010000:1.0:1789892643.804179:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 29 pid: 190664 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.804193:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055452288 00000100:00100000:0.0:1789892643.804207:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789892643.804214:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892643.804215:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 30 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.804219:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3618:x1876835055451136:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892643.804223:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055451904 00000100:00100000:1.0:1789892643.804230:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055451904 00000100:00100000:2.0:1789892643.804231:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055452416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892643.804233:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892643.804243:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 31 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.804250:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00010000:00010000:1.0:1789892643.804255:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 31 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804263:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.804267:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+31:3618:x1876835055452032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892643.804273:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 31 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.804283:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892643.804284:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055452416 00000100:00100000:1.0:1789892643.804289:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055452416 00010000:00010000:0.0:1789892643.804289:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af0a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af09b expref: 31 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.804292:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 31 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804297:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00010000:00010000:1.0:1789892643.804303:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 32 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.804313:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892643.804314:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+31:3618:x1876835055451392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892643.804325:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 31 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.804326:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892643.804335:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 31 pid: 194990 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.804335:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00010000:00010000:3.0:1789892643.804353:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af06a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af063 expref: 31 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.804356:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 31 pid: 194990 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.804356:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903083650050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+31:3618:x1876835055452160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892643.804356:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+31:3618:x1876835055451136:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.804379:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00010000:00010000:1.0:1789892643.804380:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892643.804390:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892643.804391:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 30 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.804398:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af08d expref: 29 pid: 194990 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.804403:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1789892643.804418:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3618:x1876835055452544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892643.804419:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892643.804425:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 28 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.804426:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3618:x1876835055452032:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (583us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892643.804428:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892643.804438:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 28 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.804445:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00010000:00010000:1.0:1789892643.804450:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af05c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af055 expref: 28 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.804452:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 28 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804455:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3618:x1876835055451392:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892643.804466:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789892643.804476:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1789892643.804480:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3620:x1876835055451648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892643.804482:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892643.804482:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6000/0xd5b980e0d62af032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af02b expref: 26 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.804492:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892643.804497:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892643.804499:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 24 pid: 190664 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804501:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1789892643.804512:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055452288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892643.804518:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 24 pid: 190664 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.804520:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892643.804524:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903083650050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055452160:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (534us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892643.804528:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 24 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.804535:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082132300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055452544:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (486us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892643.804545:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af07f expref: 24 pid: 190664 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.804545:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00010000:00010000:2.0:1789892643.804554:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 24 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.804556:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00010000:00010000:3.0:1789892643.804576:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892643.804576:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af04e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af047 expref: 21 pid: 190662 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.804583:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00010000:00010000:2.0:1789892643.804588:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892643.804595:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055451904:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892643.804600:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789892643.804615:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055452416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892643.804615:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892643.804624:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 20 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.804625:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055451648:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (553us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892643.804627:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892643.804630:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055452288:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (496us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892643.804637:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 20 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.804647:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:0.0:1789892643.804649:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 20 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804660:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00010000:00010000:1.0:1789892643.804670:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 19 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.804673:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892643.804702:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892643.804710:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af071 expref: 18 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.804714:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af039 expref: 18 pid: 190663 timeout: 3434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.804725:0:190656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804732:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055451648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892643.804735:0:190656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804740:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055452288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892643.804746:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892643.804751:0:190656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.804759:0:190656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.804764:0:190656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.804770:0:190656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.804775:0:190656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98000 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:0.0:1789892643.804779:0:190656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892643.804786:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3620:x1876835055452416:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.804798:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055452544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892643.804802:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00010000:00010000:0.0:1789892643.804804:0:190656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.804812:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055452416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892643.804826:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055451392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892643.804836:0:190656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804840:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055452160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892643.804850:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892643.804857:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055451136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892643.804858:0:214852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892643.804869:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055452032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892643.804880:0:214852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.804885:0:214852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af0a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.804891:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3620:x1876835055451904:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.804899:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1789892643.804911:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055451904:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789892643.849746:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892643.849754:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 150 10000000:01000000:3.0:1789892643.849760:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892643.849812:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.849822:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.849833:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.849855:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055452672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.849954:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.849996:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.850037:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055452672 00000100:00100000:2.0:1789892643.850046:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055452672 00000100:00100000:2.0:1789892643.850098:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1789892643.850106:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055452672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892643.850121:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892643.850134:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af0b0 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.850158:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.850168:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.850176:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382e00, rc 0) 00000100:00100000:2.0:1789892643.850230:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055452672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.850237:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:3.0:1789892643.850269:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055452672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892643.850283:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.850290:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.850347:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055452800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.850368:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.850383:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.850405:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055452800 00000100:00100000:2.0:1789892643.850409:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055452800 00000100:00100000:2.0:1789892643.850430:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1789892643.850435:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055452800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892643.850555:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055452800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.850561:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:3.0:1789892643.850589:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055452800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.850616:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055452928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.850652:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.850667:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f289c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.850705:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055452928 00000100:00100000:1.0:1789892643.850711:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055452928 00000100:00100000:1.0:1789892643.850743:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:1.0:1789892643.850749:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055452928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.850834:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055452928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.850841:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:3.0:1789892643.850861:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055452928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.851219:0:214856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214856:1876835055453056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892643.851247:0:214856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.851265:0:214856:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.851284:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055453056 00000100:00100000:1.0:1789892643.851289:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055453056 00000100:00100000:1.0:1789892643.851312:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1789892643.851316:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214856:x1876835055453056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.851391:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214856:x1876835055453056:12345-0@lo:502:llog_process_th.0 Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.851398:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:3.0:1789892643.851421:0:214856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214856:1876835055453056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892643.851459:0:214856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214856:1876835055453184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892643.851492:0:214856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.851510:0:214856:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.851528:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055453184 00000100:00100000:2.0:1789892643.851533:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055453184 00000100:00100000:2.0:1789892643.851559:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1789892643.851565:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214856:x1876835055453184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892643.851644:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:214856:x1876835055453184:12345-0@lo:502:llog_process_th.0 Request processed in 77us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.851653:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00100000:3.0:1789892643.851657:0:214856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214856:1876835055453184:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892643.851696:0:214856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:0.0:1789892643.851771:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:0.0:1789892643.851793:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892643.851800:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.851809:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892643.851816:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789892643.851817:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:0.0:1789892643.851819:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892643.851835:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.851841:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.851846:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.851867:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.851894:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.851924:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.851930:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055453312 00000100:00100000:2.0:1789892643.851935:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055453312 00000100:00100000:2.0:1789892643.851958:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:2.0:1789892643.851962:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055453312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892643.851968:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892643.851974:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af0be expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.851986:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.851992:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.851997:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382800, rc 0) 00000100:00100000:2.0:1789892643.852025:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055453312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 62us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.852037:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:0.0:1789892643.852055:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892643.852067:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.852073:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.852109:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.852137:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.852152:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.852171:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055453440 00000100:00100000:1.0:1789892643.852178:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055453440 00000100:00100000:1.0:1789892643.852232:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:1.0:1789892643.852242:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055453440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.852320:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055453440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.852337:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:0.0:1789892643.852347:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.852370:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.852408:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.852423:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.852443:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055453568 00000100:00100000:1.0:1789892643.852447:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055453568 00000100:00100000:1.0:1789892643.852468:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:1.0:1789892643.852474:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055453568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.852537:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055453568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.852543:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1789892643.852566:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892643.853157:0:214857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:0.0:1789892643.853222:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:0.0:1789892643.853240:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789892643.853244:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.853250:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892643.853261:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892643.853263:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 150 10000000:01000000:0.0:1789892643.853265:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892643.853275:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.853281:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.853286:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.853294:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.853314:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892643.853335:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055453696 00000100:00100000:0.0:1789892643.853337:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.853339:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055453696 00000100:00100000:2.0:1789892643.853364:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:2.0:1789892643.853368:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055453696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892643.853374:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892643.853380:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af0cc expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.853391:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.853398:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.853404:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382400, rc 0) 00000100:00100000:2.0:1789892643.853439:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055453696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.853444:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00100000:0.0:1789892643.853460:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892643.853470:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.853476:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.853500:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.853519:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.853532:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.853537:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055453824 00000100:00100000:2.0:1789892643.853541:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055453824 00000100:00100000:2.0:1789892643.853562:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:2.0:1789892643.853566:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055453824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892643.853618:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055453824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.853627:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:0.0:1789892643.853635:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.853666:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.853712:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.853731:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.853744:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055453952 00000100:00100000:1.0:1789892643.853750:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055453952 00000100:00100000:1.0:1789892643.853777:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1789892643.853784:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055453952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.853848:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055453952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.853854:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:0.0:1789892643.853874:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055453952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892643.854049:0:214858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214858:1876835055454080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892643.854079:0:214858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892643.854094:0:214858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031833b63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.854115:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055454080 00000100:00100000:1.0:1789892643.854120:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055454080 00000100:00100000:1.0:1789892643.854142:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1789892643.854147:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214858:x1876835055454080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.854244:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214858:x1876835055454080:12345-0@lo:502:llog_process_th.0 Request processed in 94us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.854247:0:214858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214858:1876835055454080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.854259:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00100000:2.0:1789892643.854282:0:214858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214858:1876835055454208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892643.854310:0:214858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892643.854324:0:214858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031833b63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.854346:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055454208 00000100:00100000:0.0:1789892643.854350:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055454208 00000100:00100000:0.0:1789892643.854373:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:0.0:1789892643.854379:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214858:x1876835055454208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.854446:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:214858:x1876835055454208:12345-0@lo:502:llog_process_th.0 Request processed in 67us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.854453:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00100000:2.0:1789892643.854459:0:214858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214858:1876835055454208:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892643.854481:0:214858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:0.0:1789892643.854517:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:0.0:1789892643.854539:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892643.854543:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.854549:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892643.854555:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789892643.854556:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:0.0:1789892643.854557:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892643.854568:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.854573:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.854587:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.854597:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.854616:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.854630:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.854641:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055454336 00000100:00100000:2.0:1789892643.854646:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055454336 00000100:00100000:2.0:1789892643.854675:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1789892643.854704:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055454336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892643.854710:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892643.854717:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af0da expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.854727:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.854733:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.854738:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383800, rc 0) 00000100:00100000:2.0:1789892643.854764:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055454336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.854768:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:0.0:1789892643.854795:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892643.854804:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.854810:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892643.854837:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.854856:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.854877:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.854887:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055454464 00000100:00100000:1.0:1789892643.854891:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055454464 00000100:00100000:1.0:1789892643.854915:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:1.0:1789892643.854921:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055454464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.854990:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055454464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.854997:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1789892643.855000:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.855026:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.855054:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.855070:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.855078:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055454592 00000100:00100000:1.0:1789892643.855082:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055454592 00000100:00100000:1.0:1789892643.855104:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:1.0:1789892643.855109:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055454592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.855168:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055454592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.855175:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00100000:0.0:1789892643.855199:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892643.855755:0:214859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:3.0:1789892643.855821:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:3.0:1789892643.855840:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892643.855846:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.855857:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892643.855866:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892643.855868:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 150 10000000:01000000:3.0:1789892643.855871:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892643.855887:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.855895:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.855904:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.855919:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.855949:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.855969:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055454720 00000100:00100000:0.0:1789892643.855973:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055454720 00000100:00100000:3.0:1789892643.855977:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.856005:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:0.0:1789892643.856010:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055454720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892643.856016:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892643.856023:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af0e8 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.856035:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.856042:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.856046:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892643.856073:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055454720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.856077:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:3.0:1789892643.856105:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892643.856118:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.856139:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.856180:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.856224:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.856243:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.856272:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055454848 00000100:00100000:2.0:1789892643.856277:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055454848 00000100:00100000:2.0:1789892643.856309:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1789892643.856318:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055454848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892643.856394:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055454848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.856401:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:3.0:1789892643.856414:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.856435:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.856463:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.856477:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.856505:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055454976 00000100:00100000:1.0:1789892643.856509:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055454976 00000100:00100000:1.0:1789892643.856531:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:1.0:1789892643.856536:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055454976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.856600:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055454976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.856605:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:3.0:1789892643.856634:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055454976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.856850:0:214860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214860:1876835055455104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.856881:0:214860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892643.856906:0:214860:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030837950c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.856918:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055455104 00000100:00100000:2.0:1789892643.856922:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055455104 00000100:00100000:2.0:1789892643.856950:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1789892643.856957:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214860:x1876835055455104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892643.857034:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214860:x1876835055455104:12345-0@lo:502:llog_process_th.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.857042:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1789892643.857069:0:214860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214860:1876835055455104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.857105:0:214860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214860:1876835055455232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.857137:0:214860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892643.857152:0:214860:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030837950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.857211:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055455232 00000100:00100000:0.0:1789892643.857216:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055455232 00000100:00100000:0.0:1789892643.857242:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1789892643.857248:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214860:x1876835055455232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.857314:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:214860:x1876835055455232:12345-0@lo:502:llog_process_th.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.857320:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:1.0:1789892643.857325:0:214860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214860:1876835055455232:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892643.857347:0:214860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:3.0:1789892643.857412:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:3.0:1789892643.857428:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892643.857433:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.857441:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892643.857447:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892643.857448:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 172 10000000:01000000:3.0:1789892643.857450:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892643.857462:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.857468:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.857488:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.857499:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055455360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.857523:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.857540:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.857562:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055455360 00000100:00100000:2.0:1789892643.857568:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055455360 00000100:00100000:2.0:1789892643.857604:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:2.0:1789892643.857612:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055455360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892643.857620:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892643.857630:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af0f6 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.857646:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.857656:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.857693:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383a00, rc 0) 00000100:00100000:2.0:1789892643.857733:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055455360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.857741:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:3.0:1789892643.857805:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055455360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892643.857814:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.857821:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.857849:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055455488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.857869:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892643.857893:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055455488 00000100:00100000:3.0:1789892643.857896:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.857898:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055455488 00000100:00100000:1.0:1789892643.857925:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:1.0:1789892643.857930:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055455488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.857988:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055455488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.857995:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00100000:3.0:1789892643.858003:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055455488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.858026:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055455616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.858055:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.858069:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.858073:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055455616 00000100:00100000:1.0:1789892643.858077:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055455616 00000100:00100000:1.0:1789892643.858100:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1789892643.858107:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055455616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.858179:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055455616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892643.858197:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055455616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.858202:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1789892643.858392:0:214861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214861:1876835055455744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.858421:0:214861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892643.858435:0:214861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031812549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.858449:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055455744 00000100:00100000:0.0:1789892643.858453:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055455744 00000100:00100000:0.0:1789892643.858476:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:0.0:1789892643.858481:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214861:x1876835055455744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.858556:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214861:x1876835055455744:12345-0@lo:502:llog_process_th.0 Request processed in 74us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.858563:0:214861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214861:1876835055455744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.858571:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000020:01000000:1.0:1789892643.858586:0:214861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892643.858597:0:214861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892643.858599:0:214861:0:(obd_config.c:1561:class_process_config()) marker 160 (0x1) lustre-MDT0001-m del lustre.qpool1 00000020:00000080:1.0:1789892643.858605:0:214861:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1789892643.858699:0:214861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214861:1876835055455872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.858737:0:214861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892643.858769:0:214861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031812549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.858773:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055455872 00000100:00100000:2.0:1789892643.858777:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055455872 00000100:00100000:2.0:1789892643.858803:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:2.0:1789892643.858810:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214861:x1876835055455872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892643.858879:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:214861:x1876835055455872:12345-0@lo:502:llog_process_th.0 Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.858887:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:1.0:1789892643.858889:0:214861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214861:1876835055455872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892643.858906:0:214861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892643.858910:0:214861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892643.858912:0:214861:0:(obd_config.c:1561:class_process_config()) marker 160 (0x2) lustre-MDT0001-m del lustre.qpool1 00000040:00080000:1.0:1789892643.858916:0:214861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 175 count 172 00000020:01000000:3.0:1789892643.858961:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 172-174 (rc=0) 10000000:01000000:3.0:1789892643.858982:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789892643.858986:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.858996:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892643.859002:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892643.859003:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 150 10000000:01000000:3.0:1789892643.859005:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892643.859015:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.859020:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.859025:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.859033:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.859052:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.859065:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.859071:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055456000 00000100:00100000:1.0:1789892643.859076:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055456000 00000100:00100000:1.0:1789892643.859095:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:1.0:1789892643.859100:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055456000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892643.859106:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892643.859113:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af104 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.859126:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.859132:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.859137:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7800, rc 0) 00000100:00100000:1.0:1789892643.859164:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055456000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.859168:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00100000:3.0:1789892643.859196:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892643.859206:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.859212:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.859237:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.859254:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.859274:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.859277:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055456128 00000100:00100000:1.0:1789892643.859282:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055456128 00000100:00100000:1.0:1789892643.859306:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:1.0:1789892643.859313:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055456128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892643.859378:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055456128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.859389:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:3.0:1789892643.859394:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.859423:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.859451:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.859465:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.859479:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055456256 00000100:00100000:0.0:1789892643.859483:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055456256 00000100:00100000:0.0:1789892643.859504:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:0.0:1789892643.859509:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055456256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.859566:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055456256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.859573:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00100000:3.0:1789892643.859580:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.859783:0:214862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214862:1876835055456384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.859812:0:214862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.859835:0:214862:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892643.859846:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055456384 00000100:00100000:2.0:1789892643.859852:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055456384 00000100:00100000:2.0:1789892643.859875:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:2.0:1789892643.859881:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214862:x1876835055456384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892643.859960:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214862:x1876835055456384:12345-0@lo:502:llog_process_th.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892643.859969:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00100000:0.0:1789892643.859978:0:214862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214862:1876835055456384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.860011:0:214862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214862:1876835055456512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.860037:0:214862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.860052:0:214862:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186402a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.860057:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055456512 00000100:00100000:1.0:1789892643.860061:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055456512 00000100:00100000:1.0:1789892643.860084:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:1.0:1789892643.860091:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214862:x1876835055456512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.860147:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:214862:x1876835055456512:12345-0@lo:502:llog_process_th.0 Request processed in 57us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.860154:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:0.0:1789892643.860154:0:214862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214862:1876835055456512:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892643.860180:0:214862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:3.0:1789892643.860248:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:3.0:1789892643.860262:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892643.860267:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.860273:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892643.860278:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789892643.860279:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 172 10000000:01000000:3.0:1789892643.860281:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892643.860293:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.860298:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.860302:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.860312:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.860334:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.860355:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.860358:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055456640 00000100:00100000:1.0:1789892643.860363:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055456640 00000100:00100000:1.0:1789892643.860386:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1789892643.860393:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055456640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892643.860401:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892643.860409:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af112 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.860424:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.860431:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892643.860436:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892643.860463:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055456640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.860468:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:3.0:1789892643.860492:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892643.860501:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.860506:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.860534:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.860554:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.860573:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.860587:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055456768 00000100:00100000:0.0:1789892643.860591:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055456768 00000100:00100000:0.0:1789892643.860612:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:0.0:1789892643.860617:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055456768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.860676:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055456768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.860705:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:3.0:1789892643.860725:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.860751:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.860780:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.860801:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.860813:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055456896 00000100:00100000:0.0:1789892643.860817:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055456896 00000100:00100000:0.0:1789892643.860836:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:0.0:1789892643.860841:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055456896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.860898:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055456896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.860903:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00100000:3.0:1789892643.860911:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055456896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.861054:0:214863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214863:1876835055457024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.861094:0:214863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.861109:0:214863:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.861123:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055457024 00000100:00100000:1.0:1789892643.861133:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055457024 00000100:00100000:1.0:1789892643.861156:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1789892643.861161:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214863:x1876835055457024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.861263:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214863:x1876835055457024:12345-0@lo:502:llog_process_th.0 Request processed in 101us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892643.861270:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00100000:0.0:1789892643.861283:0:214863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214863:1876835055457024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892643.861305:0:214863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892643.861311:0:214863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892643.861312:0:214863:0:(obd_config.c:1561:class_process_config()) marker 159 (0x1) lustre-MDT0000-m del lustre.qpool1 00000020:00000080:0.0:1789892643.861316:0:214863:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1789892643.861903:0:214863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214863:1876835055457152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892643.861931:0:214863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892643.861953:0:214863:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319f11c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892643.861961:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055457152 00000100:00100000:1.0:1789892643.861966:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055457152 00000100:00100000:1.0:1789892643.861989:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:1.0:1789892643.861994:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214863:x1876835055457152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.862055:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:214863:x1876835055457152:12345-0@lo:502:llog_process_th.0 Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.862060:0:214863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:214863:1876835055457152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892643.862065:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000020:01000000:0.0:1789892643.862083:0:214863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892643.862088:0:214863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892643.862090:0:214863:0:(obd_config.c:1561:class_process_config()) marker 159 (0x2) lustre-MDT0000-m del lustre.qpool1 00000040:00080000:0.0:1789892643.862094:0:214863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 175 count 172 00000020:01000000:3.0:1789892643.862172:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 172-174 (rc=0) 10000000:01000000:3.0:1789892643.862201:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892643.862206:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.862213:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892643.862219:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892643.862220:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:3.0:1789892643.862222:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892643.862240:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.862245:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.862250:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.862260:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055457280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.862283:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.862299:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.862303:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055457280 00000100:00100000:0.0:1789892643.862307:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055457280 00000100:00100000:0.0:1789892643.862329:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:0.0:1789892643.862333:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055457280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892643.862345:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892643.862352:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af120 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.862363:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.862370:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892643.862376:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98c00, rc 0) 00000100:00100000:0.0:1789892643.862404:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055457280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892643.862410:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:3.0:1789892643.862431:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055457280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892643.862440:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.862445:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892643.862473:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055457408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892643.862492:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892643.862505:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182f28900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892643.862511:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055457408 00000100:00100000:0.0:1789892643.862515:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055457408 00000100:00100000:0.0:1789892643.862535:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1789892643.862539:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055457408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892643.862583:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055457408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 43us (89us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892643.862589:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:3.0:1789892643.862608:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055457408:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789892643.862625:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892643.862629:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892643.862634:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892643.921803:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892644.027836:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892644.027917:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062728064 00000100:00100000:1.0:1789892644.027931:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062728064 00000100:00100000:1.0:1789892644.027996:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1901 00000100:00100000:1.0:1789892644.028007:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062728064:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892644.028026:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892644.028047:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260344 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892644.028079:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892644.028089:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892644.028098:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6600, rc 0) 00000100:00100000:1.0:1789892644.028201:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062728064:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 195us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892644.028210:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1901 00000100:00100000:3.0:1789892644.029139:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892644.029197:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062728192 00000100:00100000:1.0:1789892644.029203:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062728192 00000100:00100000:1.0:1789892644.029239:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1902 00000100:00100000:1.0:1789892644.029247:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062728192:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892644.029385:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062728192:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 138us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892644.029391:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1902 00000100:00100000:3.0:1789892644.029997:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892644.030037:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062728320 00000100:00100000:2.0:1789892644.030043:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062728320 00000100:00100000:2.0:1789892644.030074:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1903 00000100:00100000:2.0:1789892644.030081:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062728320:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892644.030166:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062728320:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 86us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892644.030194:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1903 00000100:00100000:3.0:1789892644.031262:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892644.031301:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062728448 00000100:00100000:0.0:1789892644.031306:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062728448 00000100:00100000:0.0:1789892644.031336:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1904 00000100:00100000:0.0:1789892644.031343:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214306:x1876835062728448:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892644.031432:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214306:x1876835062728448:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 89us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892644.031446:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1904 00000100:00100000:3.0:1789892644.032210:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892644.032249:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062728576 00000100:00100000:1.0:1789892644.032254:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062728576 00000100:00100000:1.0:1789892644.032279:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1905 00000100:00100000:1.0:1789892644.032283:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214306:x1876835062728576:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892644.032345:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214306:x1876835062728576:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892644.032352:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1905 00000100:00100000:3.0:1789892644.033288:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892644.033329:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062728704 00000100:00100000:1.0:1789892644.033335:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062728704 00000100:00100000:1.0:1789892644.033368:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1906 00000100:00100000:1.0:1789892644.033378:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062728704:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892644.033386:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892644.033395:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26034b expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892644.033410:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892644.033423:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892644.033429:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7000, rc 0) 00000100:00100000:1.0:1789892644.033454:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062728704:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892644.033459:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1906 00000100:00100000:3.0:1789892644.033994:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892644.034039:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062728832 00000100:00100000:2.0:1789892644.034045:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062728832 00000100:00100000:2.0:1789892644.034073:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1907 00000100:00100000:2.0:1789892644.034081:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062728832:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892644.034137:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062728832:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 56us (142us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892644.034146:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1907 00000100:00100000:1.0:1789892644.882859:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055457536:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.882867:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055457792:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.882959:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892644.882960:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892644.882999:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055458048:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.883017:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789892644.883024:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876835055457664:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892644.883038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892644.883057:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892644.883061:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789892644.883069:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055457920:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.883081:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876835055458176:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892644.883102:0:191408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055457792 00000100:00100000:3.0:1789892644.883111:0:191408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055457792 00000100:00100000:1.0:1789892644.883115:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892644.883134:0:193007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055457536 00000100:00100000:0.0:1789892644.883139:0:193007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055457536 00000100:00100000:3.0:1789892644.883155:0:191408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055458048 00000100:00100000:1.0:1789892644.883158:0:194988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055457664 00000100:00100000:3.0:1789892644.883160:0:191408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055458048 00000100:00100000:1.0:1789892644.883164:0:194988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055457664 00000100:00100000:0.0:1789892644.883166:0:193007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055457920 00000100:00100000:0.0:1789892644.883170:0:193007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055457920 00000100:00100000:3.0:1789892644.883197:0:191408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789892644.883209:0:191408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903085c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+13:3621:x1876835055457792:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.883214:0:193007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789892644.883227:0:193007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0001_UUID+13:3619:x1876835055457536:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892644.883229:0:194988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789892644.883243:0:194988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0001_UUID+13:3619:x1876835055458048:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.883295:0:193007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0001_UUID+13:3619:x1876835055457536:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 72us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892644.883299:0:191408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903085c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+13:3621:x1876835055457792:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892644.883306:0:193007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789892644.883313:0:194988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0001_UUID+13:3619:x1876835055458048:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892644.883316:0:191408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789892644.883326:0:193007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789892644.883332:0:194988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789892644.883337:0:193007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+12:3619:x1876835055457920:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892644.883359:0:194988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789892644.883369:0:194988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+12:3621:x1876835055457664:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.883375:0:193007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+12:3619:x1876835055457920:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 41us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892644.883381:0:193007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789892644.883408:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892644.883418:0:194988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876835055457664:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892644.883431:0:194988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789892644.883450:0:194988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055458176 00000100:00100000:1.0:1789892644.883453:0:194988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055458176 00000100:00100000:0.0:1789892644.883470:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055457792:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892644.883486:0:194988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789892644.883497:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876835055457664:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892644.883500:0:194988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876835055458176:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.883546:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055457920:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892644.883555:0:194988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876835055458176:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892644.883560:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055457536:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892644.883565:0:194988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789892644.883575:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055458048:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892644.883603:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876835055458176:0@lo:601:lquota_wb_lustr.0 00010000:00010000:2.0:1789892644.945779:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892645.905872:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055458304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892645.905958:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892645.906002:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055458304 00000100:00100000:1.0:1789892645.906013:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055458304 00000100:00100000:1.0:1789892645.906072:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789892645.906084:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055458304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892645.906114:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892645.906202:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055458304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892645.906209:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789892645.906252:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055458304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789892645.969803:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789892646.046130:0:215057:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff0a827470 20000000:00000080:2.0:1789892646.046143:0:215057:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff903090423c00 uarg=0000000000000000 00000040:00100000:2.0:1789892646.046681:0:215057:0:(llog.c:1072:llog_reverse_process()) index 152 : idx 137 20000000:01000000:2.0:1789892646.046687:0:215057:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 142 cmd:0xce021 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:2.0:1789892646.046699:0:215057:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892646.046953:0:215058:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 141 marker 149 1->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:2.0:1789892646.047004:0:215058:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 143 marker 149 2->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:2.0:1789892646.047042:0:215058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000040:00080000:1.0:1789892646.047233:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].153, 224 off36048 20000000:01000000:1.0:1789892646.047248:0:215057:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892646.047259:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].154, 128 off36176 00000040:00080000:1.0:1789892646.047269:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].155, 224 off36400 20000000:01000000:1.0:1789892646.047279:0:215057:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1789892646.047468:0:215059:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 163 marker 150 1->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:1.0:1789892646.047485:0:215059:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 150 2->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892646.047494:0:215059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 175 count 172 00000040:00080000:2.0:1789892646.047584:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].175, 224 off40216 20000000:01000000:2.0:1789892646.047593:0:215057:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789892646.047603:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].176, 136 off40352 00000040:00080000:2.0:1789892646.047613:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].177, 224 off40576 20000000:01000000:2.0:1789892646.047621:0:215057:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892646.048205:0:215060:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 163 marker 151 1->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:2.0:1789892646.048234:0:215060:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 151 2->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:2.0:1789892646.048274:0:215060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 175 count 172 00000040:00080000:1.0:1789892646.048358:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].175, 224 off40216 20000000:01000000:1.0:1789892646.048367:0:215057:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892646.048385:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].176, 136 off40352 00000040:00080000:1.0:1789892646.048395:0:215057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].177, 224 off40576 10000000:01000000:1.0:1789892646.048405:0:215057:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892646.048426:0:215057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048445:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048455:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048463:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048468:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048472:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048477:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048481:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048485:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048489:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048502:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048507:0:215057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048513:0:215057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048543:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048554:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 9 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.048565:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082130a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458432:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892646.048644:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048651:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 9 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.048658:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458560:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892646.048726:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048733:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 23 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.048752:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458688:0@lo:104: 00000100:00100000:1.0:1789892646.048792:0:215057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892646.048826:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.048832:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 23 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.048838:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458816:0@lo:104: 00000100:00100000:1.0:1789892646.048855:0:215057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892646.048877:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.048887:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055458688 00010000:00010000:1.0:1789892646.048887:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 23 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.048900:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458944:0@lo:104: 00000100:00100000:0.0:1789892646.048900:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055458816 00000100:00100000:3.0:1789892646.048902:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055458688 00000100:00100000:0.0:1789892646.048913:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055458816 00000100:00100000:1.0:1789892646.048935:0:215057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892646.048974:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.048997:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055458944 00010000:00010000:1.0:1789892646.049003:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 23 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.049007:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055458944 00000100:00100000:1.0:1789892646.049028:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459072:0@lo:104: 00000100:00100000:2.0:1789892646.049040:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789892646.049071:0:215057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.049075:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215057:x1876835055458816:12345-0@lo:104: 00000100:00100000:0.0:1789892646.049085:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00010000:00010000:2.0:1789892646.049114:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.049114:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215057:x1876835055458688:12345-0@lo:104: 00010000:00010000:1.0:1789892646.049128:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.049133:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055459072 00010000:00010000:0.0:1789892646.049143:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.049144:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055459072 00010000:00010000:1.0:1789892646.049189:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 23 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.049202:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459200:0@lo:104: 00010000:00010000:2.0:1789892646.049226:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892646.049253:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:215057:x1876835055458816:12345-0@lo:104: Request processed in 192us (396us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892646.049269:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892646.049282:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789892646.049283:0:215057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892646.049288:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:215057:x1876835055458688:12345-0@lo:104: Request processed in 186us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892646.049303:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789892646.049310:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:215057:x1876835055458944:12345-0@lo:104: 00000100:00100000:0.0:1789892646.049317:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00010000:00010000:3.0:1789892646.049323:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.049331:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892646.049345:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055459200 00010000:00010000:1.0:1789892646.049346:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 23 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.049355:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789892646.049358:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055459200 00000100:00100000:0.0:1789892646.049374:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319dcdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215057:x1876835055459072:12345-0@lo:104: 00000100:00100000:1.0:1789892646.049379:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459328:0@lo:104: 00010000:00010000:3.0:1789892646.049395:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789892646.049395:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892646.049432:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1789892646.049433:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215057:x1876835055458944:12345-0@lo:104: Request processed in 123us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892646.049451:0:215057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.049469:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215057:x1876835055459200:12345-0@lo:104: 00000100:00100000:3.0:1789892646.049480:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00010000:00010000:2.0:1789892646.049493:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.049512:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.049513:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055459328 00000100:00100000:3.0:1789892646.049526:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055459328 00010000:00010000:1.0:1789892646.049534:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 23 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.049541:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789892646.049553:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459456:0@lo:104: 00000100:00100000:0.0:1789892646.049575:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319dcdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215057:x1876835055459072:12345-0@lo:104: Request processed in 183us (492us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892646.049584:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789892646.049586:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1789892646.049600:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215057:x1876835055459200:12345-0@lo:104: Request processed in 148us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892646.049609:0:215057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892646.049621:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.049628:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 23 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.049634:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459584:0@lo:104: 00010000:00010000:1.0:1789892646.049665:0:215057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.049674:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00010000:00010000:1.0:1789892646.049684:0:215057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 23 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.049698:0:215057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459712:0@lo:104: 00000100:00100000:3.0:1789892646.049716:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215057:x1876835055459328:12345-0@lo:104: 00000100:00100000:1.0:1789892646.049720:0:215057:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892646.049726:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00010000:00010000:3.0:1789892646.049741:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892646.049753:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055459456 00000100:00100000:0.0:1789892646.049755:0:190653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789892646.049759:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055459456 00000100:00100000:1.0:1789892646.049771:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458688:0@lo:104: 00000100:00100000:1.0:1789892646.049788:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458816:0@lo:104: 00000100:00100000:2.0:1789892646.049789:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1789892646.049804:0:190653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.049811:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309214e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215057:x1876835055459456:12345-0@lo:104: 00000100:00100000:1.0:1789892646.049820:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458944:0@lo:104: 00010000:00010000:2.0:1789892646.049821:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.049823:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789892646.049842:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459072:0@lo:104: 00000100:00100000:3.0:1789892646.049844:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215057:x1876835055459328:12345-0@lo:104: Request processed in 170us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892646.049859:0:190653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892646.049872:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459200:0@lo:104: 00000100:00100000:3.0:1789892646.049878:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00010000:00010000:2.0:1789892646.049879:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789892646.049896:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459328:0@lo:104: 00000100:00100000:2.0:1789892646.049897:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309214e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215057:x1876835055459456:12345-0@lo:104: Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892646.049897:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055459584 00000100:00100000:0.0:1789892646.049907:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055459584 00000100:00100000:1.0:1789892646.049908:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459456:0@lo:104: 00000100:00100000:2.0:1789892646.049917:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1789892646.049951:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055459712 00000100:00100000:2.0:1789892646.049957:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055459712 00000100:00100000:0.0:1789892646.049958:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1789892646.049983:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215057:x1876835055459584:12345-0@lo:104: 00010000:00010000:0.0:1789892646.049995:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050019:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789892646.050028:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050038:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c600 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892646.050040:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 10000000:00010000:1.0:1789892646.050046:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.050058:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215057:x1876835055459712:12345-0@lo:104: 00010000:00010000:1.0:1789892646.050062:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050073:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050075:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 10000000:00010000:1.0:1789892646.050080:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050092:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:0.0:1789892646.050093:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215057:x1876835055459584:12345-0@lo:104: Request processed in 117us (295us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892646.050107:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050117:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789892646.050133:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1789892646.050143:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215057:x1876835055459712:12345-0@lo:104: Request processed in 86us (291us total) trans 0 rc 0/0 10000000:01000000:1.0:1789892646.050150:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892646.050187:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00010000:00010000:2.0:1789892646.050196:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9ca00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892646.050222:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050236:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789892646.050239:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050243:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.050253:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459584:0@lo:104: 00010000:00010000:1.0:1789892646.050254:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.050286:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055459712:0@lo:104: 10000000:00010000:2.0:1789892646.050292:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050296:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d000 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892646.050315:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1789892646.050317:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892646.050318:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892646.050334:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789892646.050345:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050347:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050350:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050364:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050392:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af119 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892646.050412:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050417:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9de00 already unused, calling callback (ffffffffc130dc20) 10000000:01000000:3.0:1789892646.050434:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892646.050436:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050438:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892646.050460:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050471:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af127 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050472:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050474:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789892646.050487:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050516:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050527:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892646.050543:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892646.050544:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c400 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892646.050545:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892646.050555:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050556:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892646.050556:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892646.050559:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050586:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050590:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050601:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af10b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050633:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892646.050635:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98a00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892646.050652:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892646.050654:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050657:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050659:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892646.050671:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050681:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892646.050682:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1789892646.050693:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892646.050698:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892646.050723:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af0f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0fd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050736:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892646.050739:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1789892646.050741:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050743:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050745:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050752:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050772:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050791:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892646.050793:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99a00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892646.050806:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050807:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892646.050817:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050823:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.050835:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892646.050866:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050869:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af0e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0ef expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050875:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af0da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0e1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892646.050901:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892646.050912:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892646.050919:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892646.050931:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892646.050933:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.050939:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789892646.050942:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892646.050943:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892646.050956:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050960:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d800 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892646.050967:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050974:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892646.050974:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055460096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892646.050978:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.050985:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.050995:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.051022:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892646.051037:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789892646.051039:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.051042:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af0cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0d3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.051042:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892646.051050:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892646.051070:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055460608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892646.051087:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af0be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0c5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.051091:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892646.051093:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.051097:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892646.051101:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892646.051107:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892646.051108:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892646.051113:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892646.051119:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892646.051125:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.051126:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055460224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892646.051129:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892646.051133:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892646.051149:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af0b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af0b7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.051189:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055459840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892646.051222:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892646.051227:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892646.051235:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892646.051244:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892646.051268:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055459968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892646.051286:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055460096 00000100:00100000:0.0:1789892646.051292:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055460096 00000100:00100000:3.0:1789892646.051323:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055460736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892646.051330:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 24 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.051345:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892646.051362:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055460608 00000100:00100000:0.0:1789892646.051366:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055460608 00010000:00010000:0.0:1789892646.051387:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 25 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.051388:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892646.051404:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055460480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892646.051441:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055460224 00000100:00100000:0.0:1789892646.051445:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055460224 00000100:00100000:2.0:1789892646.051461:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:0.0:1789892646.051466:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 26 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.051482:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055460352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892646.051485:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055459968 00000100:00100000:1.0:1789892646.051495:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055459968 00010000:00010000:1.0:1789892646.051531:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 27 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.051537:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055459840 00000100:00100000:0.0:1789892646.051562:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055459840 00000100:00100000:3.0:1789892646.051563:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892646.051569:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062728960 00000100:00100000:2.0:1789892646.051573:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892646.051578:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062728960 00010000:00010000:0.0:1789892646.051596:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 28 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.051610:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055460864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892646.051611:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 10 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892646.051619:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055460352 00000100:00100000:0.0:1789892646.051620:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062729088 00000100:00100000:0.0:1789892646.051631:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062729088 00000100:00100000:2.0:1789892646.051634:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055460352 00000100:00100000:3.0:1789892646.051659:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892646.051659:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 11 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.051663:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00010000:00010000:2.0:1789892646.051673:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 29 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.051684:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3620:x1876835055460096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892646.051695:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892646.051703:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 29 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.051734:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892646.051739:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055460864 00000100:00100000:0.0:1789892646.051743:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055460864 00000100:00100000:2.0:1789892646.051748:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055460736 00000100:00100000:2.0:1789892646.051755:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055460736 00010000:00010000:1.0:1789892646.051757:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 30 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.051762:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 31 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.051781:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 31 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.051789:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af10b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af104 expref: 31 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.051807:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00010000:00010000:1.0:1789892646.051821:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892646.051825:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1789892646.051826:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903083652850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3620:x1876835055460608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892646.051835:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892646.051845:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789892646.051847:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3621:x1876835055460224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892646.051849:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 30 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.051868:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3620:x1876835055460096:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (839us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892646.051870:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892646.051873:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3619:x1876835055459968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892646.051887:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 30 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.051901:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 30 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.051903:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892646.051917:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 30 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.051918:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789892646.051952:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00010000:00010000:3.0:1789892646.051959:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 29 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.051966:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3618:x1876835055459840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892646.052007:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892646.052013:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382400/0xd5b980e0d62af0d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af0cc expref: 29 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.052015:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 29 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.052024:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 29 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.052081:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af0fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af0f6 expref: 28 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.052089:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af120 expref: 28 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.052113:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 28 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.052129:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892646.052130:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892646.052132:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892646.052142:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af112 expref: 26 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.052152:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892646.052229:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3621:x1876835055460224:12345-0@lo:103:ldlm_bl.0 Request processed in 388us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892646.052235:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903083652850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055460608:12345-0@lo:103:ldlm_bl.0 Request processed in 412us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.052261:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1789892646.052269:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3619:x1876835055459968:12345-0@lo:103:ldlm_bl.0 Request processed in 378us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892646.052271:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789892646.052272:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055459840:12345-0@lo:103:ldlm_bl.0 Request processed in 282us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.052297:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 449 00000100:00100000:3.0:1789892646.052326:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062728960:12345-192.168.203.53@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789892646.052328:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00010000:00010000:3.0:1789892646.052335:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892646.052342:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00010000:00010000:3.0:1789892646.052347:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 11 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.052357:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00010000:00010000:3.0:1789892646.052362:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 11 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.052376:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055460352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892646.052379:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892646.052382:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 451 00010000:00010000:0.0:1789892646.052391:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892646.052398:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00010000:00010000:0.0:1789892646.052399:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 21 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892646.052408:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062729088:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892646.052423:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 21 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.052427:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062728960:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 110us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892646.052448:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055460864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892646.052450:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892646.052459:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 449 00010000:00010000:0.0:1789892646.052460:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af0ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af0e8 expref: 21 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.052470:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 11 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.052482:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892646.052501:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00010000:00010000:1.0:1789892646.052503:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 21 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.052506:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892646.052532:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3621:x1876835055460736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892646.052533:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 10 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.052549:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892646.052553:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055460352:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (1000us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892646.052561:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 20 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892646.052567:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00010000:00010000:1.0:1789892646.052591:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 19 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.052608:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 19 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.052635:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af0b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af0b0 expref: 19 pid: 194990 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892646.052640:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892646.052644:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382800/0xd5b980e0d62af0c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af0be expref: 19 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892646.052651:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892646.052653:0:215057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26034b expref: 10 pid: 190662 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.052660:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892646.052675:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2396:x1876835062729088:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 276us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892646.052684:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 451 00000100:00100000:0.0:1789892646.052710:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082130a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458432:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892646.052734:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892646.052751:0:215057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af12e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260344 expref: 8 pid: 190663 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.052753:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3621:x1876835055460736:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892646.052769:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3618:x1876835055460864:12345-0@lo:103:ldlm_bl.0 Request processed in 346us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.052773:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789892646.052776:0:215057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215057:1876835055458560:192.168.203.53@tcp:104: 00000100:00100000:1.0:1789892646.052807:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00010000:00010000:0.0:1789892646.052889:0:215057:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.053052:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055460480 00000100:00100000:3.0:1789892646.053058:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055460480 00000100:00100000:0.0:1789892646.053074:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055460224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892646.053111:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055460736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892646.053143:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055459840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892646.053147:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055459968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892646.053154:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 16 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892646.053199:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055460352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892646.053202:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055460608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892646.053227:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1789892646.053246:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055460480:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892646.053247:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055460096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892646.053259:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055460864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892646.053268:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892646.053280:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 16 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053309:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 16 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053337:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383800/0xd5b980e0d62af0e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af0da expref: 16 pid: 190664 timeout: 3436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053352:0:202163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053358:0:202163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053369:0:202163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053374:0:202163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053390:0:202163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053395:0:202163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053398:0:202163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6200 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:3.0:1789892646.053401:0:202163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053407:0:202163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053420:0:202163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892646.053435:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892646.053459:0:215057:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.053466:0:215057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892646.053471:0:215057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af13c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892646.053481:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055460480:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.053488:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1789892646.053538:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055460480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892646.417919:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055461376:0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.417939:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055460992:0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.418010:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055461120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892646.418042:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892646.418045:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055461248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892646.418105:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055461376 00000100:00100000:0.0:1789892646.418108:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892646.418117:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.418121:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055461376 00000100:00100000:1.0:1789892646.418148:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055461888:0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.418182:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055461632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892646.418184:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055461760:0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.418253:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789892646.418254:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892646.418261:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892646.418261:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.418282:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055461376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.418296:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055462144:0@lo:400:kworker.0 00000100:00100000:3.0:1789892646.418336:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055462272:0@lo:400:kworker.0 00000100:00100000:1.0:1789892646.418354:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055462400:0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.418362:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.418377:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055461376:12345-0@lo:400:kworker.0 Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.418390:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892646.418402:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055462656:0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.418403:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789892646.418429:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876835055462784:0@lo:400:kworker.0 00000100:00100000:1.0:1789892646.418430:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.418438:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055461888 00000100:00100000:2.0:1789892646.418448:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055461888 00000100:00100000:0.0:1789892646.418470:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055461248 00000100:00100000:0.0:1789892646.418478:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055461248 00000100:00100000:2.0:1789892646.418505:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055462144 00000100:00100000:3.0:1789892646.418507:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.418513:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055462144 00000100:00100000:1.0:1789892646.418525:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055461376:0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.418554:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055461632 00000100:00100000:0.0:1789892646.418560:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055461632 00000100:00100000:2.0:1789892646.418579:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789892646.418579:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789892646.418588:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789892646.418601:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055461888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892646.418608:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876835055462528:0@lo:400:kworker.0 00000100:00100000:3.0:1789892646.418610:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1876835055461248:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892646.418618:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789892646.418642:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055461632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789892646.418672:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1789892646.418673:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892646.418714:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055461888:12345-0@lo:400:kworker.0 Request processed in 122us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892646.418724:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789892646.418753:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789892646.418764:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055461632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892646.418773:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892646.418777:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055462144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.418795:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789892646.418837:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1876835055461248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 236us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892646.418846:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055461888:0@lo:400:kworker.0 00000100:00100000:3.0:1789892646.418851:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789892646.418863:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055462144:12345-0@lo:400:kworker.0 Request processed in 90us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892646.418865:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055462272 00000100:00100000:0.0:1789892646.418875:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055462272 00000100:00100000:2.0:1789892646.418881:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789892646.418917:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055462400 00000100:00100000:1.0:1789892646.418923:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055462400 00000100:00080000:2.0:1789892646.418930:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892646.418937:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055462784 00000100:00080000:2.0:1789892646.418939:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789892646.418943:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055462528 00000100:00100000:3.0:1789892646.418944:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055462784 00000100:00080000:2.0:1789892646.418947:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892646.418952:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055462528 00000100:00100000:2.0:1789892646.418972:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055461120 00000100:00100000:2.0:1789892646.418977:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055461120 00000100:00100000:1.0:1789892646.419003:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789892646.419020:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1789892646.419028:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876835055462272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.419036:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055461760 00000100:00100000:0.0:1789892646.419039:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1789892646.419048:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055462400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.419050:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055461760 00000100:00100000:0.0:1789892646.419078:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876835055462784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.419099:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789892646.419113:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055461120:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789892646.419129:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055462400:12345-0@lo:400:kworker.0 Request processed in 94us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892646.419150:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876835055462272:12345-0@lo:400:kworker.0 Request processed in 126us (759us total) trans 0 rc 0/0 00000004:00000024:2.0:1789892646.419151:0:190675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:0.0:1789892646.419158:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876835055462784:12345-0@lo:400:kworker.0 Request processed in 92us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.419162:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789892646.419202:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789892646.419216:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789892646.419231:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1789892646.419239:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055461120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.419248:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876835055462528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.419251:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789892646.419269:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789892646.419287:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055461760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.419321:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892646.419327:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055462400:0@lo:400:kworker.0 00000100:00100000:3.0:1789892646.419329:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876835055462528:12345-0@lo:400:kworker.0 Request processed in 87us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.419352:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789892646.419364:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055461760:12345-0@lo:400:kworker.0 Request processed in 84us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892646.419365:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055461504:0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.419389:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:1.0:1789892646.419391:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff903082131f80 x1876835055462528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892646.419399:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055460992 00000100:00100000:3.0:1789892646.419411:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055460992 00000100:00100000:2.0:1789892646.419423:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892646.419427:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876835055462528:0@lo:400:kworker.0 00000100:00100000:3.0:1789892646.419487:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789892646.419498:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055461504 00000100:00100000:2.0:1789892646.419500:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055462016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892646.419505:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055460992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.419505:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055461248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892646.419506:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055461504 00000100:00100000:0.0:1789892646.419537:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055461760:0@lo:400:kworker.0 00000100:00100000:0.0:1789892646.419557:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055462272:0@lo:400:kworker.0 00000100:00100000:1.0:1789892646.419577:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00010000:00080000:0.0:1789892646.419587:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff903082133b80 x1876835055462784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892646.419604:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055461504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892646.419610:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055460992:12345-0@lo:400:kworker.0 Request processed in 101us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892646.419610:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892646.419644:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789892646.419658:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876835055462784:0@lo:400:kworker.0 00000100:00100000:2.0:1789892646.419666:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055460992:0@lo:400:kworker.0 00000100:00100000:1.0:1789892646.419716:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055461504:12345-0@lo:400:kworker.0 Request processed in 127us (302us total) trans 0 rc 0/0 00000100:00080000:3.0:1789892646.419723:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892646.419731:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00080000:3.0:1789892646.419734:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789892646.419740:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055461504:0@lo:400:kworker.0 00000100:00100000:3.0:1789892646.419777:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055462016 00000100:00100000:3.0:1789892646.419784:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055462016 00000100:00100000:1.0:1789892646.419795:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892646.419822:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789892646.419835:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055462016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789892646.419851:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892646.419862:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055462656 00000100:00100000:0.0:1789892646.419869:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055462656 00000100:00100000:1.0:1789892646.419883:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055461120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789892646.419910:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055462016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892646.419922:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789892646.419930:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055461632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892646.419958:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00080000:2.0:1789892646.419959:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892646.419981:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055462656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892646.419992:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055462144:0@lo:400:kworker.0 00000100:00100000:3.0:1789892646.420028:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055462016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892646.420059:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055462656:12345-0@lo:400:kworker.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892646.420070:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1789892646.420084:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055462656:0@lo:400:kworker.0 00010000:00010000:2.0:1789892646.993931:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892647.419863:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892647.419951:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062729216 00000100:00100000:0.0:1789892647.419964:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062729216 00000100:00100000:0.0:1789892647.420032:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1908 00000100:00100000:0.0:1789892647.420043:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062729216:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892647.420069:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892647.420091:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260352 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.420136:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.420147:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.420156:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892647.420231:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062729216:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 191us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.420237:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1908 00000100:00100000:0.0:1789892647.421198:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892647.421252:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062729344 00000100:00100000:1.0:1789892647.421258:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062729344 00000100:00100000:1.0:1789892647.421291:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1909 00000100:00100000:1.0:1789892647.421307:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062729344:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.421442:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062729344:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 137us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.421449:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1909 00000100:00100000:2.0:1789892647.422143:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892647.422193:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062729472 00000100:00100000:1.0:1789892647.422197:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062729472 00000100:00100000:1.0:1789892647.422232:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1910 00000100:00100000:1.0:1789892647.422237:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062729472:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.422319:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062729472:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.422325:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1910 00000100:00100000:3.0:1789892647.423419:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892647.423472:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062729600 00000100:00100000:2.0:1789892647.423477:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062729600 00000100:00100000:2.0:1789892647.423518:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1911 00000100:00100000:2.0:1789892647.423528:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214367:x1876835062729600:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892647.423629:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214367:x1876835062729600:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 103us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.423635:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1911 00000100:00100000:0.0:1789892647.424401:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892647.424441:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062729728 00000100:00100000:2.0:1789892647.424450:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062729728 00000100:00100000:2.0:1789892647.424477:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1912 00000100:00100000:2.0:1789892647.424483:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214367:x1876835062729728:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892647.424560:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214367:x1876835062729728:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.424566:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1912 00000100:00100000:3.0:1789892647.425495:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892647.425566:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062729856 00000100:00100000:1.0:1789892647.425572:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062729856 00000100:00100000:1.0:1789892647.425599:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1913 00000100:00100000:1.0:1789892647.425605:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062729856:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892647.425611:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892647.425621:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260359 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.425636:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.425643:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.425649:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892647.425706:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062729856:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.425712:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1913 00000100:00100000:3.0:1789892647.426307:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892647.426343:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062729984 00000100:00100000:1.0:1789892647.426347:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062729984 00000100:00100000:1.0:1789892647.426370:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1914 00000100:00100000:1.0:1789892647.426374:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062729984:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.426420:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062729984:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 45us (114us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892647.426426:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1914 10000000:01000000:3.0:1789892647.505808:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892647.505817:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 153 10000000:01000000:3.0:1789892647.505824:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892647.505881:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.505895:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.505909:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.505943:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055462912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.506023:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.506079:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.506082:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055462912 00000100:00100000:2.0:1789892647.506092:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055462912 00000100:00100000:2.0:1789892647.506153:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1789892647.506178:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055462912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892647.506204:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892647.506237:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af151 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.506266:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.506280:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.506291:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383400, rc 0) 00000100:00100000:2.0:1789892647.506341:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055462912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.506350:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:3.0:1789892647.506391:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055462912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892647.506410:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.506422:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.506492:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.506532:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.506550:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.506588:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055463040 00000100:00100000:2.0:1789892647.506594:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055463040 00000100:00100000:2.0:1789892647.506619:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:2.0:1789892647.506623:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055463040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.506756:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055463040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.506761:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:3.0:1789892647.506810:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.506853:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.506896:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.506925:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.506932:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055463168 00000100:00100000:1.0:1789892647.506938:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055463168 00000100:00100000:1.0:1789892647.506970:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:1.0:1789892647.506977:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055463168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.507067:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055463168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.507074:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:3.0:1789892647.507105:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.507469:0:215061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215061:1876835055463296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.507499:0:215061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.507513:0:215061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.507542:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055463296 00000100:00100000:1.0:1789892647.507546:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055463296 00000100:00100000:1.0:1789892647.507570:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1789892647.507575:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:215061:x1876835055463296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892647.507656:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:215061:x1876835055463296:12345-0@lo:502:llog_process_th.0 Request processed in 80us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.507663:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1789892647.507701:0:215061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215061:1876835055463296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.507740:0:215061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215061:1876835055463424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.507766:0:215061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.507784:0:215061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.507803:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055463424 00000100:00100000:2.0:1789892647.507808:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055463424 00000100:00100000:2.0:1789892647.507833:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1789892647.507841:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:215061:x1876835055463424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.507928:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:215061:x1876835055463424:12345-0@lo:502:llog_process_th.0 Request processed in 87us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.507937:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:3.0:1789892647.507954:0:215061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215061:1876835055463424:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892647.507974:0:215061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:2.0:1789892647.508048:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:2.0:1789892647.508080:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892647.508087:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.508094:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892647.508101:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892647.508103:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:2.0:1789892647.508105:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892647.508117:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.508122:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.508128:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892647.508139:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.508182:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.508202:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.508220:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055463552 00000100:00100000:0.0:1789892647.508226:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055463552 00000100:00100000:0.0:1789892647.508258:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:0.0:1789892647.508264:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055463552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892647.508271:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892647.508278:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af15f expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.508291:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.508299:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.508305:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98000, rc 0) 00000100:00100000:0.0:1789892647.508342:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055463552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.508348:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1789892647.508371:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892647.508386:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.508396:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892647.508443:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.508476:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.508493:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.508515:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055463680 00000100:00100000:1.0:1789892647.508521:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055463680 00000100:00100000:1.0:1789892647.508552:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:1.0:1789892647.508558:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055463680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.508629:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055463680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.508637:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1789892647.508654:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.508704:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.508745:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892647.508770:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055463808 00000100:00100000:2.0:1789892647.508775:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.508775:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055463808 00000100:00100000:1.0:1789892647.508802:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:1.0:1789892647.508806:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055463808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.508870:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055463808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.508876:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1789892647.508902:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892647.509724:0:215062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:3.0:1789892647.509774:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:3.0:1789892647.509801:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789892647.509806:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.509814:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892647.509821:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892647.509822:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 153 10000000:01000000:3.0:1789892647.509824:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892647.509837:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.509848:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.509854:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.509864:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.509887:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.509909:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055463936 00000100:00100000:3.0:1789892647.509913:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.509914:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055463936 00000100:00100000:2.0:1789892647.509940:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:2.0:1789892647.509945:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055463936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892647.509952:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892647.509960:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af16d expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.509976:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.509987:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.509996:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382200, rc 0) 00000100:00100000:2.0:1789892647.510035:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055463936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.510044:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:3.0:1789892647.510054:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055463936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892647.510067:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.510074:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.510104:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.510123:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.510137:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.510201:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055464064 00000100:00100000:0.0:1789892647.510207:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055464064 00000100:00100000:0.0:1789892647.510234:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:0.0:1789892647.510241:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055464064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892647.510308:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055464064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.510315:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1789892647.510331:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.510352:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.510381:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.510395:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.510413:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055464192 00000100:00100000:1.0:1789892647.510418:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055464192 00000100:00100000:1.0:1789892647.510446:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:1.0:1789892647.510451:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055464192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.510519:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055464192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.510526:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1789892647.510530:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.510739:0:215063:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215063:1876835055464320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892647.510770:0:215063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892647.510792:0:215063:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319882d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.510798:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055464320 00000100:00100000:2.0:1789892647.510804:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055464320 00000100:00100000:2.0:1789892647.510840:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1789892647.510849:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:215063:x1876835055464320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.510934:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:215063:x1876835055464320:12345-0@lo:502:llog_process_th.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.510943:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:1.0:1789892647.510961:0:215063:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215063:1876835055464320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892647.510995:0:215063:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215063:1876835055464448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892647.511021:0:215063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892647.511039:0:215063:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319882d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.511049:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055464448 00000100:00100000:2.0:1789892647.511055:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055464448 00000100:00100000:2.0:1789892647.511084:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1789892647.511091:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:215063:x1876835055464448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.511180:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:215063:x1876835055464448:12345-0@lo:502:llog_process_th.0 Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.511189:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:1.0:1789892647.511196:0:215063:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215063:1876835055464448:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892647.511217:0:215063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:3.0:1789892647.511277:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:3.0:1789892647.511298:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892647.511302:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.511308:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892647.511314:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892647.511315:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:3.0:1789892647.511316:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892647.511327:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.511332:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.511338:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.511345:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.511365:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.511379:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.511395:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055464576 00000100:00100000:0.0:1789892647.511405:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055464576 00000100:00100000:0.0:1789892647.511429:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:0.0:1789892647.511433:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055464576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892647.511440:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892647.511454:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af17b expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.511467:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.511474:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.511479:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98800, rc 0) 00000100:00100000:0.0:1789892647.511507:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055464576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.511513:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1789892647.511531:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892647.511541:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.511547:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.511572:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.511598:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.511611:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.511626:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055464704 00000100:00100000:1.0:1789892647.511630:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055464704 00000100:00100000:1.0:1789892647.511654:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:1.0:1789892647.511659:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055464704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.511744:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055464704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.511751:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1789892647.511758:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.511779:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.511806:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.511827:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.511832:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055464832 00000100:00100000:2.0:1789892647.511838:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055464832 00000100:00100000:2.0:1789892647.511871:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:2.0:1789892647.511886:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055464832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.511958:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055464832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892647.511966:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.511970:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000040:00080000:2.0:1789892647.512637:0:215064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:3.0:1789892647.512704:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:3.0:1789892647.512724:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892647.512729:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.512735:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892647.512741:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892647.512743:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 153 10000000:01000000:3.0:1789892647.512744:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892647.512755:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.512760:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.512766:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.512773:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.512798:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.512818:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.512821:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055464960 00000100:00100000:2.0:1789892647.512826:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055464960 00000100:00100000:2.0:1789892647.512850:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:2.0:1789892647.512856:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055464960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892647.512862:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892647.512875:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af189 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.512887:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.512894:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.512899:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382c00, rc 0) 00000100:00100000:2.0:1789892647.512927:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055464960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.512933:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1789892647.512953:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055464960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892647.512962:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.512968:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.512994:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.513012:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.513024:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.513081:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055465088 00000100:00100000:0.0:1789892647.513086:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055465088 00000100:00100000:0.0:1789892647.513114:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:0.0:1789892647.513122:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055465088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892647.513196:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055465088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.513203:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1789892647.513209:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.513231:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.513258:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.513271:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.513285:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055465216 00000100:00100000:1.0:1789892647.513289:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055465216 00000100:00100000:1.0:1789892647.513311:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1789892647.513316:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055465216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.513374:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055465216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.513381:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1789892647.513387:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.513543:0:215065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215065:1876835055465344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.513569:0:215065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.513583:0:215065:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.513587:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055465344 00000100:00100000:2.0:1789892647.513592:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055465344 00000100:00100000:2.0:1789892647.513618:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:2.0:1789892647.513624:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:215065:x1876835055465344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.513717:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:215065:x1876835055465344:12345-0@lo:502:llog_process_th.0 Request processed in 92us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.513723:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1789892647.513812:0:215065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215065:1876835055465344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.513838:0:215065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215065:1876835055465472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.513864:0:215065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.513887:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055465472 00000100:00100000:3.0:1789892647.513892:0:215065:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.513892:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055465472 00000100:00100000:2.0:1789892647.513918:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1789892647.513924:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:215065:x1876835055465472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.513994:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:215065:x1876835055465472:12345-0@lo:502:llog_process_th.0 Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892647.514003:0:215065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215065:1876835055465472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.514005:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000040:00080000:3.0:1789892647.514023:0:215065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:2.0:1789892647.514061:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:2.0:1789892647.514089:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892647.514093:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.514100:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892647.514106:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892647.514108:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 175 10000000:01000000:2.0:1789892647.514109:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892647.514120:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.514125:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.514131:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892647.514140:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.514175:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.514189:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.514201:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055465600 00000100:00100000:1.0:1789892647.514206:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055465600 00000100:00100000:1.0:1789892647.514228:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:1.0:1789892647.514233:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055465600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892647.514239:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892647.514246:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af197 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.514258:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.514273:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.514279:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7800, rc 0) 00000100:00100000:1.0:1789892647.514308:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055465600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.514314:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:2.0:1789892647.514318:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892647.514330:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.514337:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892647.514371:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.514408:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.514425:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.514427:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055465728 00000100:00100000:1.0:1789892647.514432:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055465728 00000100:00100000:1.0:1789892647.514451:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:1.0:1789892647.514457:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055465728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.514512:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055465728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.514517:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1789892647.514521:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.514545:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.514574:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.514588:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.514595:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055465856 00000100:00100000:1.0:1789892647.514599:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055465856 00000100:00100000:1.0:1789892647.514620:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1789892647.514624:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055465856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.514705:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055465856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.514712:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:2.0:1789892647.514733:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055465856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.514894:0:215066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215066:1876835055465984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.514923:0:215066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.514943:0:215066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.514957:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055465984 00000100:00100000:0.0:1789892647.514963:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055465984 00000100:00100000:0.0:1789892647.514990:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:0.0:1789892647.514997:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215066:x1876835055465984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892647.515089:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215066:x1876835055465984:12345-0@lo:502:llog_process_th.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.515096:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:2.0:1789892647.515102:0:215066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215066:1876835055465984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892647.515126:0:215066:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892647.515135:0:215066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892647.515137:0:215066:0:(obd_config.c:1561:class_process_config()) marker 163 (0x1) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:2.0:1789892647.515142:0:215066:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789892647.515174:0:215066:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000100:00100000:2.0:1789892647.515190:0:215066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215066:1876835055466112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.515217:0:215066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.515230:0:215066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.515250:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055466112 00000100:00100000:0.0:1789892647.515254:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055466112 00000100:00100000:0.0:1789892647.515276:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:0.0:1789892647.515281:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215066:x1876835055466112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892647.515340:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215066:x1876835055466112:12345-0@lo:502:llog_process_th.0 Request processed in 59us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.515347:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1789892647.515357:0:215066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215066:1876835055466112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892647.515384:0:215066:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892647.515390:0:215066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892647.515392:0:215066:0:(obd_config.c:1561:class_process_config()) marker 163 (0x2) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:2.0:1789892647.515396:0:215066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 178 count 175 00000020:01000000:3.0:1789892647.515439:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 175-177 (rc=0) 10000000:01000000:3.0:1789892647.515460:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789892647.515464:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.515469:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892647.515475:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892647.515476:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 153 10000000:01000000:3.0:1789892647.515478:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892647.515488:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.515493:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.515498:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.515506:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055466240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.515525:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.515538:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.515549:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055466240 00000100:00100000:1.0:1789892647.515554:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055466240 00000100:00100000:1.0:1789892647.515577:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:1.0:1789892647.515581:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055466240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892647.515594:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892647.515601:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af1a5 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.515613:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.515619:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.515624:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7400, rc 0) 00000100:00100000:1.0:1789892647.515651:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055466240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.515656:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:3.0:1789892647.515694:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055466240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892647.515705:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.515719:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.515744:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055466368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.515764:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.515781:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.515791:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055466368 00000100:00100000:1.0:1789892647.515795:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055466368 00000100:00100000:1.0:1789892647.515816:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:1.0:1789892647.515821:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055466368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892647.515873:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055466368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.515880:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:3.0:1789892647.515889:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055466368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.515910:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055466496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.515937:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.515950:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.515966:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055466496 00000100:00100000:0.0:1789892647.515970:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055466496 00000100:00100000:0.0:1789892647.515991:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:0.0:1789892647.515996:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055466496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892647.516051:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055466496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.516058:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1789892647.516065:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055466496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.516264:0:215067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215067:1876835055466624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.516292:0:215067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.516305:0:215067:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.516322:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055466624 00000100:00100000:0.0:1789892647.516326:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055466624 00000100:00100000:0.0:1789892647.516346:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:0.0:1789892647.516351:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:215067:x1876835055466624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892647.516411:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:215067:x1876835055466624:12345-0@lo:502:llog_process_th.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.516418:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1789892647.516426:0:215067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215067:1876835055466624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.516459:0:215067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215067:1876835055466752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892647.516485:0:215067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.516497:0:215067:0:(client.c:2702:ptlrpc_set_wait()) set ffff903084af9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.516506:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055466752 00000100:00100000:1.0:1789892647.516510:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055466752 00000100:00100000:1.0:1789892647.516533:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1789892647.516538:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:215067:x1876835055466752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892647.516595:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:215067:x1876835055466752:12345-0@lo:502:llog_process_th.0 Request processed in 56us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892647.516609:0:215067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215067:1876835055466752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892647.516610:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000040:00080000:3.0:1789892647.516633:0:215067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:2.0:1789892647.516704:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:2.0:1789892647.516732:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892647.516737:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.516745:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892647.516751:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892647.516753:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 175 10000000:01000000:2.0:1789892647.516754:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892647.516766:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.516772:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.516777:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892647.516787:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055466880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.516810:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892647.516831:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055466880 00000100:00100000:2.0:1789892647.516835:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.516835:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055466880 00000100:00100000:1.0:1789892647.516862:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:1.0:1789892647.516869:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055466880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892647.516874:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892647.516880:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af1b3 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.516891:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.516898:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892647.516902:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6400, rc 0) 00000100:00100000:1.0:1789892647.516928:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055466880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.516933:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:2.0:1789892647.516956:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055466880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892647.516966:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892647.516972:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892647.517005:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055467008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.517043:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.517064:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.517075:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055467008 00000100:00100000:0.0:1789892647.517079:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055467008 00000100:00100000:0.0:1789892647.517105:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:0.0:1789892647.517110:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055467008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892647.517180:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055467008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.517186:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1789892647.517212:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055467008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.517244:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055467136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.517283:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.517305:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.517305:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055467136 00000100:00100000:0.0:1789892647.517312:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055467136 00000100:00100000:0.0:1789892647.517332:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:0.0:1789892647.517336:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055467136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892647.517390:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055467136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892647.517395:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:2.0:1789892647.517416:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055467136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892647.517619:0:215068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215068:1876835055467264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.517649:0:215068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.517662:0:215068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892647.517673:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055467264 00000100:00100000:1.0:1789892647.517735:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055467264 00000100:00100000:1.0:1789892647.517770:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1789892647.517777:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215068:x1876835055467264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892647.517848:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215068:x1876835055467264:12345-0@lo:502:llog_process_th.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892647.517854:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:2.0:1789892647.517865:0:215068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215068:1876835055467264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892647.517885:0:215068:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892647.517891:0:215068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892647.517892:0:215068:0:(obd_config.c:1561:class_process_config()) marker 162 (0x1) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:2.0:1789892647.517896:0:215068:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789892647.517903:0:215068:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000020:01000004:2.0:1789892647.518198:0:215069:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789892647.518202:0:215069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:1.0:1789892647.518213:0:215068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215068:1876835055467392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892647.518263:0:215068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892647.518285:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055467392 00000100:00100000:2.0:1789892647.518289:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055467392 00000100:00100000:1.0:1789892647.518295:0:215068:0:(client.c:2702:ptlrpc_set_wait()) set ffff903182bc9180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892647.518314:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:2.0:1789892647.518319:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215068:x1876835055467392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892647.518389:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215068:x1876835055467392:12345-0@lo:502:llog_process_th.0 Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892647.518399:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1789892647.518409:0:215068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215068:1876835055467392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892647.518437:0:215068:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892647.518443:0:215068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892647.518445:0:215068:0:(obd_config.c:1561:class_process_config()) marker 162 (0x2) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892647.518450:0:215068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 178 count 175 00000020:01000000:3.0:1789892647.518510:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 175-177 (rc=0) 10000000:01000000:3.0:1789892647.518531:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892647.518542:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.518552:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892647.518559:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892647.518561:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:3.0:1789892647.518564:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892647.518578:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.518586:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.518594:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.518608:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055467520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.518636:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.518651:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.518698:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055467520 00000100:00100000:0.0:1789892647.518704:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055467520 00000100:00100000:0.0:1789892647.518737:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:0.0:1789892647.518746:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055467520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892647.518755:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892647.518765:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af1c1 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.518781:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.518791:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892647.518800:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99400, rc 0) 00000100:00100000:0.0:1789892647.518837:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055467520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892647.518853:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055467520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892647.518854:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00010000:00010000:3.0:1789892647.518866:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.518873:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892647.518903:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055467648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892647.518929:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.518948:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892647.518967:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055467648 00000100:00100000:0.0:1789892647.518974:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055467648 00000100:00100000:0.0:1789892647.519000:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1789892647.519007:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055467648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892647.519064:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055467648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (133us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892647.519073:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055467648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892647.519075:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 10000000:01000000:3.0:1789892647.519101:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892647.519106:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892647.519112:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892647.953884:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789892647.953911:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055467776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892647.954007:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892647.954050:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055467776 00000100:00100000:3.0:1789892647.954060:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055467776 00000100:00100000:3.0:1789892647.954116:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789892647.954125:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055467776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789892647.954180:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892647.954242:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055467776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892647.954250:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789892647.954285:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055467776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789892648.017838:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789892648.620404:0:215167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc51b2dd30 20000000:00000080:0.0:1789892648.620420:0:215167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9030908c2c00 uarg=0000000000000000 00000040:00100000:0.0:1789892648.620937:0:215167:0:(llog.c:1072:llog_reverse_process()) index 155 : idx 137 20000000:01000000:0.0:1789892648.620944:0:215167:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 154 cmd:0xce022 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:0.0:1789892648.620957:0:215167:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool2 fl=4 20000000:01000000:2.0:1789892648.621214:0:215168:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 138 marker 146 1->4: lustre-clilov new lustre.qpool2 20000000:01000000:2.0:1789892648.621265:0:215168:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 140 marker 146 2->4: lustre-clilov new lustre.qpool2 00000040:00080000:2.0:1789892648.621276:0:215168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000040:00080000:0.0:1789892648.621393:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].156, 224 off36624 20000000:01000000:0.0:1789892648.621412:0:215167:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:0.0:1789892648.621423:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].157, 104 off36728 00000040:00080000:0.0:1789892648.621446:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].158, 224 off36952 20000000:01000000:0.0:1789892648.621456:0:215167:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:2.0:1789892648.621656:0:215169:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 160 marker 147 1->4: lustre-MDT0000-mdtlov new lustre.qpool2 20000000:01000000:2.0:1789892648.621671:0:215169:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 147 2->4: lustre-MDT0000-mdtlov new lustre.qpool2 00000040:00080000:2.0:1789892648.621697:0:215169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 178 count 175 00000040:00080000:0.0:1789892648.621766:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].178, 224 off40800 20000000:01000000:0.0:1789892648.621776:0:215167:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:0.0:1789892648.621786:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].179, 112 off40912 00000040:00080000:0.0:1789892648.621803:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].181, 224 off41184 20000000:01000000:0.0:1789892648.621811:0:215167:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:2.0:1789892648.622054:0:215170:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 160 marker 148 1->4: lustre-MDT0001-mdtlov new lustre.qpool2 20000000:01000000:2.0:1789892648.622070:0:215170:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 148 2->4: lustre-MDT0001-mdtlov new lustre.qpool2 00000040:00080000:2.0:1789892648.622080:0:215170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 178 count 175 00000040:00080000:0.0:1789892648.622163:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].178, 224 off40800 20000000:01000000:0.0:1789892648.622172:0:215167:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:0.0:1789892648.622183:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].179, 112 off40912 00000040:00080000:0.0:1789892648.622198:0:215167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].181, 224 off41184 10000000:01000000:0.0:1789892648.622207:0:215167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789892648.622233:0:215167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622253:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622260:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622267:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622271:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622276:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622280:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622285:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622289:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622294:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622298:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622306:0:215167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622311:0:215167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622352:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622364:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 23 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.622378:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055467904:0@lo:104: 00000100:00100000:0.0:1789892648.622445:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892648.622483:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055467904 00000100:00100000:2.0:1789892648.622491:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055467904 00010000:00010000:0.0:1789892648.622497:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622504:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 23 pid: 190662 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.622511:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468032:0@lo:104: 00000100:00100000:0.0:1789892648.622530:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892648.622543:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055468032 00000100:00100000:2.0:1789892648.622547:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055468032 00010000:00010000:0.0:1789892648.622560:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622570:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 23 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.622572:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1789892648.622583:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468160:0@lo:104: 00000100:00100000:2.0:1789892648.622585:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789892648.622595:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055467904:12345-0@lo:104: 00000100:00100000:2.0:1789892648.622599:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468032:12345-0@lo:104: 00010000:00010000:2.0:1789892648.622614:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.622619:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892648.622620:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.622648:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055468160 00010000:00010000:0.0:1789892648.622648:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.622656:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055468160 00010000:00010000:0.0:1789892648.622660:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 23 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.622669:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468288:0@lo:104: 00000100:00100000:3.0:1789892648.622717:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1789892648.622727:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215167:x1876835055468160:12345-0@lo:104: 00010000:00010000:3.0:1789892648.622736:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.622741:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892648.622746:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892648.622751:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892648.622758:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215167:x1876835055468032:12345-0@lo:104: Request processed in 162us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892648.622761:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215167:x1876835055467904:12345-0@lo:104: Request processed in 174us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892648.622777:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00010000:00010000:0.0:1789892648.622780:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.622788:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00010000:00010000:0.0:1789892648.622790:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 23 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.622798:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892648.622801:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468416:0@lo:104: 00000100:00100000:2.0:1789892648.622805:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055468288 00000100:00100000:2.0:1789892648.622811:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055468288 00000100:00100000:3.0:1789892648.622812:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:215167:x1876835055468160:12345-0@lo:104: Request processed in 85us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892648.622822:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00010000:00010000:1.0:1789892648.622823:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789892648.622833:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892648.622834:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.622845:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892648.622851:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.622853:0:190653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789892648.622861:0:191419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00010000:00010000:0.0:1789892648.622862:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622872:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 23 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.622880:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055468416 00010000:00010000:1.0:1789892648.622882:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.622886:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055468416 00000100:00100000:0.0:1789892648.622886:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468544:0@lo:104: 00000100:00100000:3.0:1789892648.622887:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1789892648.622901:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468288:12345-0@lo:104: 10000000:00010000:1.0:1789892648.622903:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.622910:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.622922:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789892648.622924:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789892648.622937:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892648.622942:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ca55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468416:12345-0@lo:104: 00010000:00010000:0.0:1789892648.622946:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.622960:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 23 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.622961:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.622972:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789892648.622981:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.622984:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468288:12345-0@lo:104: Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892648.622995:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468672:0@lo:104: 00000100:00100000:3.0:1789892648.623004:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00010000:00010000:1.0:1789892648.623005:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892648.623025:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055468544 00000100:00100000:3.0:1789892648.623028:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055468544 00010000:00010000:2.0:1789892648.623033:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789892648.623034:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892648.623041:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.623045:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055468672 00000100:00100000:2.0:1789892648.623048:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ca55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468416:12345-0@lo:104: Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892648.623050:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055468672 00010000:00010000:0.0:1789892648.623062:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623063:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af1b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1ba expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.623066:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1789892648.623083:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00010000:00010000:0.0:1789892648.623085:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 23 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.623094:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468544:12345-0@lo:104: 00010000:00010000:1.0:1789892648.623095:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1789892648.623096:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468928:0@lo:104: 00010000:00010000:1.0:1789892648.623104:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623109:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623115:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d600 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:2.0:1789892648.623117:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 10000000:00010000:1.0:1789892648.623124:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623125:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892648.623134:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468672:12345-0@lo:104: 00010000:00010000:1.0:1789892648.623140:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623144:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.623162:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623166:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:00010000:1.0:1789892648.623166:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.623179:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468544:12345-0@lo:104: Request processed in 87us (260us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892648.623190:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 23 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892648.623191:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892648.623196:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1789892648.623209:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055469056:0@lo:104: 00000100:00100000:3.0:1789892648.623216:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055468928 00010000:00010000:1.0:1789892648.623219:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.623221:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055468928 00010000:00010000:2.0:1789892648.623226:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:1.0:1789892648.623230:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892648.623234:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468672:12345-0@lo:104: Request processed in 106us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892648.623244:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1789892648.623246:0:215167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892648.623257:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789892648.623263:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468928:12345-0@lo:104: 00010000:00010000:1.0:1789892648.623263:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.623272:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.623274:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055469056 00010000:00010000:3.0:1789892648.623277:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.623280:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055469056 00010000:00010000:1.0:1789892648.623289:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af1c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1c8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.623299:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 9 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.623301:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1789892648.623315:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055469056:12345-0@lo:104: 00010000:00010000:1.0:1789892648.623322:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789892648.623325:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623325:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055469312:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892648.623328:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623330:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789892648.623342:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215167:x1876835055468928:12345-0@lo:104: Request processed in 82us (219us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892648.623355:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9cc00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892648.623359:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 10000000:00010000:1.0:1789892648.623364:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623375:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892648.623383:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892648.623389:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892648.623393:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789892648.623399:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623406:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892648.623409:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623410:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:1.0:1789892648.623418:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.623420:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:215167:x1876835055469056:12345-0@lo:104: Request processed in 108us (179us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892648.623421:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.623441:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00010000:00010000:1.0:1789892648.623442:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1789892648.623444:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892648.623451:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892648.623457:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623467:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af1a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1ac expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623471:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789892648.623472:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623478:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.623485:0:215167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623491:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892648.623505:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9da00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892648.623507:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892648.623509:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623512:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892648.623521:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623537:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623539:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d400 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892648.623541:0:215167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 9 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892648.623547:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892648.623562:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623571:0:215167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055469696:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892648.623575:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892648.623580:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789892648.623598:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623599:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af19e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623604:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623610:0:215167:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318582ee40 going to sleep for 11 seconds 00010000:00010000:2.0:1789892648.623624:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1789892648.623624:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892648.623627:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892648.623633:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623634:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623639:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055467904:0@lo:104: 00010000:00010000:3.0:1789892648.623647:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c000 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892648.623651:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892648.623653:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623655:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af190 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623657:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468032:0@lo:104: 00000100:00100000:0.0:1789892648.623673:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468160:0@lo:104: 00010000:00010000:3.0:1789892648.623699:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623702:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892648.623710:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468288:0@lo:104: 00010000:00010000:1.0:1789892648.623714:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892648.623723:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623726:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468416:0@lo:104: 00010000:00010000:2.0:1789892648.623733:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892648.623741:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623741:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468544:0@lo:104: 10000000:01000000:3.0:1789892648.623742:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892648.623742:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af17b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af182 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623760:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468672:0@lo:104: 00010000:00010000:2.0:1789892648.623764:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892648.623768:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892648.623771:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623776:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892648.623778:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055468928:0@lo:104: 00010000:00010000:1.0:1789892648.623785:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623791:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.623792:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055469056:0@lo:104: 10000000:00010000:2.0:1789892648.623805:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892648.623818:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892648.623829:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892648.623834:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623840:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892648.623840:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623843:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623850:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623857:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892648.623866:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892648.623869:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623870:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c000/0xd5b980e0d62af16d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af174 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.623876:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af15f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af166 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892648.623895:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892648.623901:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892648.623903:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892648.623906:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892648.623910:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892648.623912:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892648.623915:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892648.623919:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.623924:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892648.623929:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892648.623937:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623945:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af158 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.623959:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892648.623962:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892648.623965:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892648.623968:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892648.623983:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055468800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892648.624023:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892648.624032:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055469184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892648.624066:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055468800 00000100:00100000:1.0:1789892648.624071:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055469824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892648.624073:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892648.624073:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055468800 00000100:00100000:3.0:1789892648.624081:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055469440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892648.624102:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 24 pid: 190662 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.624112:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055469952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892648.624123:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892648.624126:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055469184 00000100:00100000:0.0:1789892648.624129:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055469184 00000100:00100000:3.0:1789892648.624140:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055469568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892648.624146:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 25 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.624175:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892648.624183:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055470336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892648.624188:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055469824 00000100:00100000:3.0:1789892648.624191:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892648.624198:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055469824 00000100:00100000:3.0:1789892648.624218:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055470208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892648.624220:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 26 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.624229:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055469952 00000100:00100000:1.0:1789892648.624232:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892648.624236:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055469952 00000100:00100000:0.0:1789892648.624244:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055469568 00000100:00100000:0.0:1789892648.624249:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055469568 00000100:00100000:3.0:1789892648.624260:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892648.624262:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 28 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.624265:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 28 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.624277:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055470336 00000100:00100000:1.0:1789892648.624284:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055470336 00000100:00100000:0.0:1789892648.624301:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055470208 00000100:00100000:0.0:1789892648.624305:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055470208 00000100:00100000:2.0:1789892648.624310:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00010000:00010000:1.0:1789892648.624310:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 29 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.624321:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 30 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.624328:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3619:x1876835055468800:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892648.624340:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00010000:00010000:2.0:1789892648.624344:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892648.624347:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1789892648.624353:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3620:x1876835055469184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892648.624355:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 30 pid: 190662 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.624360:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3619:x1876835055469824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892648.624370:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892648.624376:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892648.624381:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 30 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.624384:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 30 pid: 190662 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.624385:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 30 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.624394:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1789892648.624413:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3620:x1876835055469952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892648.624419:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 30 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.624427:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892648.624432:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 30 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.624434:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 30 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.624460:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af1ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af1b3 expref: 30 pid: 190662 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.624466:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99400/0xd5b980e0d62af1c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af1c1 expref: 30 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.624470:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af189 expref: 29 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892648.624472:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 29 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.624498:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892648.624537:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3619:x1876835055468800:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892648.624544:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00010000:00010000:1.0:1789892648.624560:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892648.624560:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892648.624562:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af17b expref: 26 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.624566:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1789892648.624574:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3618:x1876835055469568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892648.624582:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892648.624592:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 26 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.624601:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 26 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.624607:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055469824:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892648.624611:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3620:x1876835055469184:12345-0@lo:103:ldlm_bl.0 Request processed in 261us (540us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892648.624615:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af19e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af197 expref: 26 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.624621:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1789892648.624634:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00010000:00010000:2.0:1789892648.624644:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892648.624648:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892648.624648:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789892648.624662:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1789892648.624667:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3619:x1876835055470336:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892648.624710:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3618:x1876835055470208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892648.624720:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892648.624726:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 22 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.624747:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 22 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.624761:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af15f expref: 22 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.624775:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892648.624803:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055470208:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892648.624812:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1789892648.624842:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892648.624850:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892648.624857:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 20 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.624866:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 20 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.624879:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af151 expref: 20 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.624888:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055470080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892648.624889:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892648.624925:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3619:x1876835055470336:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892648.624932:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789892648.624936:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892648.624957:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055469440 00000100:00100000:0.0:1789892648.624961:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055469440 00010000:00010000:0.0:1789892648.624975:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 19 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.624978:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055469952:12345-0@lo:103:ldlm_bl.0 Request processed in 568us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892648.624983:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055470080 00000100:00100000:1.0:1789892648.624992:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055470080 00000100:00100000:3.0:1789892648.624995:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789892648.625001:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1789892648.625012:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3621:x1876835055469440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892648.625016:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 19 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.625020:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892648.625027:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 19 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.625038:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 19 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.625049:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af1ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af1a5 expref: 19 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.625060:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00010000:00010000:0.0:1789892648.625070:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892648.625076:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3621:x1876835055470080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892648.625087:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892648.625095:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 18 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.625097:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:1.0:1789892648.625123:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 18 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.625130:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3621:x1876835055469440:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892648.625141:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00010000:00010000:1.0:1789892648.625142:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382200/0xd5b980e0d62af174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af16d expref: 18 pid: 194990 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.625143:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:1.0:1789892648.625179:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892648.625205:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062730112 00000100:00100000:0.0:1789892648.625209:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062730112 00000100:00100000:1.0:1789892648.625220:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3621:x1876835055470080:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (289us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892648.625225:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 10 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.625232:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055469568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892648.625232:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3618:x1876835055469568:12345-0@lo:103:ldlm_bl.0 Request processed in 656us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892648.625237:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1789892648.625251:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789892648.625254:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062730240 00000100:00100000:0.0:1789892648.625258:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062730240 00000100:00100000:3.0:1789892648.625265:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055470208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892648.625271:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 464 00010000:00010000:0.0:1789892648.625273:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 11 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.625288:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062730112:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892648.625298:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892648.625305:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 465 00010000:00010000:1.0:1789892648.625306:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 11 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892648.625318:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062730240:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892648.625323:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 11 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625328:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892648.625337:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 11 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892648.625340:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892648.625345:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055469184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892648.625346:0:215167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af14a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260359 expref: 11 pid: 190663 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625351:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 11 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.625366:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055469952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892648.625373:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055469312:192.168.203.53@tcp:104: 00000100:00100000:1.0:1789892648.625380:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062730112:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 94us (283us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892648.625384:0:190655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.625394:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 464 00010000:00010000:0.0:1789892648.625395:0:215167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260352 expref: 10 pid: 190664 timeout: 3438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625405:0:190655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892648.625409:0:215167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215167:1876835055469696:192.168.203.53@tcp:104: 00000100:00100000:3.0:1789892648.625420:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055468800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892648.625440:0:190655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892648.625447:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055469824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892648.625464:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055470336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892648.625469:0:190655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625477:0:190655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625483:0:190655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.625485:0:215167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625488:0:190655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98c00 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:2.0:1789892648.625496:0:190655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892648.625499:0:215167:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.625507:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055469440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892648.625509:0:190655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892648.625524:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055470080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892648.625535:0:215167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625541:0:190655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625555:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af1cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892648.625575:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892648.625613:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2396:x1876835062730240:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 298us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892648.625622:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 465 00000100:00100000:3.0:1789892648.635373:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892648.635406:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892648.635430:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062730496 00000100:00100000:1.0:1789892648.635436:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062730496 00000100:00080000:2.0:1789892648.635494:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789892648.635494:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062730368 00000100:00100000:0.0:1789892648.635501:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062730368 00000100:00100000:1.0:1789892648.635503:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 456 00000100:00100000:1.0:1789892648.635516:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2396:x1876835062730496:12345-192.168.203.53@tcp:400:kworker.0 00000100:00080000:2.0:1789892648.635552:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892648.635561:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 457 00000100:00100000:1.0:1789892648.635572:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2396:x1876835062730496:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 58us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892648.635573:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2396:x1876835062730368:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892648.635593:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 456 00000100:00100000:0.0:1789892648.635608:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2396:x1876835062730368:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892648.635616:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 457 00010000:00010000:2.0:1789892649.041830:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892649.915800:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892649.915873:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062730624 00000100:00100000:1.0:1789892649.915888:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062730624 00000100:00100000:1.0:1789892649.915950:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1953 00000100:00100000:1.0:1789892649.915960:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062730624:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892649.915981:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892649.916002:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260360 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.916033:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.916043:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.916064:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7000, rc 0) 00000100:00100000:1.0:1789892649.916123:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062730624:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 165us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.916129:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1953 00000100:00100000:3.0:1789892649.916986:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892649.917035:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062730752 00000100:00100000:2.0:1789892649.917070:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062730752 00000100:00100000:2.0:1789892649.917114:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1954 00000100:00100000:2.0:1789892649.917125:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062730752:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.917306:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062730752:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 184us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892649.917312:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1954 00000100:00100000:3.0:1789892649.917890:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892649.917931:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062730880 00000100:00100000:0.0:1789892649.917936:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062730880 00000100:00100000:0.0:1789892649.917966:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1955 00000100:00100000:0.0:1789892649.917973:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062730880:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892649.918061:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062730880:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 89us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.918068:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1955 00000100:00100000:3.0:1789892649.918982:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892649.919024:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062731008 00000100:00100000:0.0:1789892649.919029:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062731008 00000100:00100000:0.0:1789892649.919056:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1956 00000100:00100000:0.0:1789892649.919062:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214385:x1876835062731008:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892649.919154:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214385:x1876835062731008:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.919162:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1956 00000100:00100000:3.0:1789892649.919840:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892649.919893:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062731136 00000100:00100000:1.0:1789892649.919899:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062731136 00000100:00100000:1.0:1789892649.919925:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1957 00000100:00100000:1.0:1789892649.919931:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214385:x1876835062731136:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892649.920000:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:214385:x1876835062731136:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.920008:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1957 00000100:00100000:3.0:1789892649.920911:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892649.920958:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062731264 00000100:00100000:2.0:1789892649.920963:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062731264 00000100:00100000:2.0:1789892649.920999:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1958 00000100:00100000:2.0:1789892649.921011:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062731264:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892649.921021:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892649.921032:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260367 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.921051:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.921062:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.921070:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382600, rc 0) 00000100:00100000:2.0:1789892649.921113:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062731264:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892649.921124:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1958 00000100:00100000:3.0:1789892649.921807:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892649.921851:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062731392 00000100:00100000:0.0:1789892649.921858:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062731392 00000100:00100000:0.0:1789892649.921889:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1959 00000100:00100000:0.0:1789892649.921899:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062731392:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892649.921959:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062731392:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 61us (152us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892649.921968:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1959 10000000:01000000:2.0:1789892649.937743:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892649.937748:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 156 10000000:01000000:2.0:1789892649.937752:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892649.937800:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.937816:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.937825:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892649.937848:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055470464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.937891:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.937929:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.937935:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055470464 00000100:00100000:0.0:1789892649.937941:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055470464 00000100:00100000:0.0:1789892649.937971:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:0.0:1789892649.937976:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055470464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892649.937985:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892649.937994:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af1e4 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.938008:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.938016:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.938022:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892649.938058:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055470464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.938064:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:2.0:1789892649.938096:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055470464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892649.938111:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.938119:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892649.938198:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055470592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.938220:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.938239:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.938275:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055470592 00000100:00100000:1.0:1789892649.938280:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055470592 00000100:00100000:1.0:1789892649.938304:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:1.0:1789892649.938310:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055470592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.938384:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055470592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.938390:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:2.0:1789892649.938416:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055470592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.938441:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055470720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.938477:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.938493:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.938529:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055470720 00000100:00100000:1.0:1789892649.938533:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055470720 00000100:00100000:1.0:1789892649.938554:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:1.0:1789892649.938559:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055470720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.938625:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055470720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.938631:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:2.0:1789892649.938669:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055470720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.939024:0:215171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215171:1876835055470848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.939059:0:215171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.939083:0:215171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.939133:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055470848 00000100:00100000:0.0:1789892649.939160:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055470848 00000100:00100000:0.0:1789892649.939194:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1789892649.939212:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:215171:x1876835055470848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.939293:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:215171:x1876835055470848:12345-0@lo:502:llog_process_th.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.939299:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:2.0:1789892649.939319:0:215171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215171:1876835055470848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.939358:0:215171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215171:1876835055470976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.939385:0:215171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.939399:0:215171:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.939422:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055470976 00000100:00100000:0.0:1789892649.939426:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055470976 00000100:00100000:0.0:1789892649.939448:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:0.0:1789892649.939453:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:215171:x1876835055470976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.939515:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:215171:x1876835055470976:12345-0@lo:502:llog_process_th.0 Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892649.939527:0:215171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215171:1876835055470976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.939533:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000040:00080000:2.0:1789892649.939549:0:215171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:3.0:1789892649.939650:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:3.0:1789892649.939706:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892649.939717:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.939730:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892649.939740:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892649.939750:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:3.0:1789892649.939754:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892649.939773:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.939790:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.939795:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.939806:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.939835:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.939869:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.939880:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055471104 00000100:00100000:1.0:1789892649.939886:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055471104 00000100:00100000:1.0:1789892649.939914:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:1.0:1789892649.939922:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055471104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892649.939931:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892649.939940:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af1f2 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.939956:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.939966:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.939987:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6a00, rc 0) 00000100:00100000:1.0:1789892649.940018:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055471104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.940026:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:3.0:1789892649.940064:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892649.940077:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.940086:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.940136:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.940177:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.940194:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.940218:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055471232 00000100:00100000:1.0:1789892649.940224:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055471232 00000100:00100000:1.0:1789892649.940248:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:1.0:1789892649.940259:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055471232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.940330:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055471232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.940338:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:3.0:1789892649.940360:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.940382:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.940411:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.940431:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.940453:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055471360 00000100:00100000:0.0:1789892649.940457:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055471360 00000100:00100000:0.0:1789892649.940480:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1789892649.940485:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055471360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892649.940561:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055471360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.940567:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:3.0:1789892649.940592:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892649.941472:0:215172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:2.0:1789892649.941548:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:2.0:1789892649.941571:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892649.941576:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.941583:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892649.941589:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892649.941590:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 156 10000000:01000000:2.0:1789892649.941592:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892649.941603:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.941609:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.941614:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892649.941632:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.941654:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.941673:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.941715:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055471488 00000100:00100000:0.0:1789892649.941720:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055471488 00000100:00100000:0.0:1789892649.941752:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1789892649.941761:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055471488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892649.941771:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892649.941782:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af200 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.941818:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.941825:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.941831:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98e00, rc 0) 00000100:00100000:0.0:1789892649.941864:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055471488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.941870:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:2.0:1789892649.941888:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892649.941899:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.941905:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892649.941935:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.941955:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.941973:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.941999:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055471616 00000100:00100000:1.0:1789892649.942005:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055471616 00000100:00100000:1.0:1789892649.942031:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:1.0:1789892649.942036:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055471616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.942090:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055471616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.942096:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1789892649.942104:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.942127:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.942171:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.942195:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.942213:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055471744 00000100:00100000:1.0:1789892649.942217:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055471744 00000100:00100000:1.0:1789892649.942237:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1789892649.942241:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055471744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.942294:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055471744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.942301:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1789892649.942316:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055471744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.942506:0:215173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215173:1876835055471872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.942534:0:215173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.942548:0:215173:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.942569:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055471872 00000100:00100000:0.0:1789892649.942574:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055471872 00000100:00100000:0.0:1789892649.942597:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:0.0:1789892649.942602:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:215173:x1876835055471872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.942670:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:215173:x1876835055471872:12345-0@lo:502:llog_process_th.0 Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.942699:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1789892649.942701:0:215173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215173:1876835055471872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.942739:0:215173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215173:1876835055472000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.942770:0:215173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892649.942792:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055472000 00000100:00100000:2.0:1789892649.942794:0:215173:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031838c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.942797:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055472000 00000100:00100000:0.0:1789892649.942822:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1789892649.942828:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:215173:x1876835055472000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.942887:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:215173:x1876835055472000:12345-0@lo:502:llog_process_th.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.942893:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1789892649.942900:0:215173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215173:1876835055472000:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892649.942924:0:215173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:3.0:1789892649.942984:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:3.0:1789892649.943007:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892649.943013:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.943024:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892649.943032:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892649.943034:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:3.0:1789892649.943036:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892649.943051:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.943059:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.943067:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.943078:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.943101:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.943117:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.943132:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055472128 00000100:00100000:1.0:1789892649.943137:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055472128 00000100:00100000:1.0:1789892649.943165:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:1.0:1789892649.943169:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055472128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892649.943174:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892649.943181:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af20e expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.943193:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 19 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.943199:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 19 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.943205:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6e00, rc 0) 00000100:00100000:1.0:1789892649.943229:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055472128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.943235:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1789892649.943257:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892649.943268:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.943283:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.943314:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.943336:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.943350:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.943361:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055472256 00000100:00100000:1.0:1789892649.943364:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055472256 00000100:00100000:1.0:1789892649.943381:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:1.0:1789892649.943385:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055472256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.943435:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055472256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.943440:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1789892649.943466:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.943487:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.943516:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.943531:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.943542:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055472384 00000100:00100000:0.0:1789892649.943546:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055472384 00000100:00100000:0.0:1789892649.943575:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:0.0:1789892649.943581:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055472384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892649.943643:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055472384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.943649:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:3.0:1789892649.943667:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892649.944496:0:215174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:2.0:1789892649.944548:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:2.0:1789892649.944571:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892649.944576:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.944584:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892649.944589:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892649.944591:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 156 10000000:01000000:2.0:1789892649.944592:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892649.944604:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.944609:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.944615:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892649.944623:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.944643:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.944661:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.944711:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055472512 00000100:00100000:0.0:1789892649.944719:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055472512 00000100:00100000:0.0:1789892649.944756:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1789892649.944766:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055472512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892649.944776:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892649.944785:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af21c expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.944799:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.944806:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.944811:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99e00, rc 0) 00000100:00100000:0.0:1789892649.944844:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055472512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.944850:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:2.0:1789892649.944873:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892649.944893:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.944900:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892649.944938:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.944959:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.944978:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.944994:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055472640 00000100:00100000:1.0:1789892649.944999:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055472640 00000100:00100000:1.0:1789892649.945027:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:1.0:1789892649.945032:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055472640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.945101:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055472640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.945108:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:2.0:1789892649.945115:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.945138:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.945182:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.945195:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.945204:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055472768 00000100:00100000:1.0:1789892649.945208:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055472768 00000100:00100000:1.0:1789892649.945228:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1789892649.945232:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055472768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.945285:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055472768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.945291:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:2.0:1789892649.945308:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055472768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.945483:0:215175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215175:1876835055472896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.945521:0:215175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.945534:0:215175:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.945557:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055472896 00000100:00100000:0.0:1789892649.945562:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055472896 00000100:00100000:0.0:1789892649.945585:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:0.0:1789892649.945591:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:215175:x1876835055472896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.945666:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:215175:x1876835055472896:12345-0@lo:502:llog_process_th.0 Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.945702:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1789892649.945722:0:215175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215175:1876835055472896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.945755:0:215175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215175:1876835055473024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.945780:0:215175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.945799:0:215175:0:(client.c:2702:ptlrpc_set_wait()) set ffff90309041dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.945812:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055473024 00000100:00100000:0.0:1789892649.945816:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055473024 00000100:00100000:0.0:1789892649.945836:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:0.0:1789892649.945841:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:215175:x1876835055473024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.945896:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:215175:x1876835055473024:12345-0@lo:502:llog_process_th.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.945903:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1789892649.945923:0:215175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215175:1876835055473024:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892649.945945:0:215175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:3.0:1789892649.946001:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:3.0:1789892649.946018:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892649.946023:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.946033:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892649.946042:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892649.946045:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 178 10000000:01000000:3.0:1789892649.946047:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892649.946064:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.946086:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.946096:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.946111:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055473152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.946156:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.946176:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.946193:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055473152 00000100:00100000:1.0:1789892649.946198:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055473152 00000100:00100000:1.0:1789892649.946218:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:1.0:1789892649.946223:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055473152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892649.946228:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892649.946235:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af22a expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.946248:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 21 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.946255:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 21 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.946260:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7a00, rc 0) 00000100:00100000:1.0:1789892649.946284:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055473152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.946297:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:3.0:1789892649.946325:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055473152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892649.946337:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.946348:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.946388:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055473280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.946420:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.946442:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.946443:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055473280 00000100:00100000:1.0:1789892649.946449:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055473280 00000100:00100000:1.0:1789892649.946469:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:1.0:1789892649.946473:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055473280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.946524:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055473280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.946530:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:3.0:1789892649.946556:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055473280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.946581:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055473408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.946621:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.946640:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.946655:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055473408 00000100:00100000:0.0:1789892649.946659:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055473408 00000100:00100000:0.0:1789892649.946704:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:0.0:1789892649.946711:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055473408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892649.946771:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055473408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.946777:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:3.0:1789892649.946787:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055473408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.946964:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215176:1876835055473536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892649.946996:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.947014:0:215176:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.947041:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055473536 00000100:00100000:0.0:1789892649.947045:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055473536 00000100:00100000:0.0:1789892649.947066:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:0.0:1789892649.947073:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215176:x1876835055473536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.947160:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215176:x1876835055473536:12345-0@lo:502:llog_process_th.0 Request processed in 87us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.947169:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1789892649.947176:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215176:1876835055473536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892649.947199:0:215176:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892649.947209:0:215176:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892649.947212:0:215176:0:(obd_config.c:1561:class_process_config()) marker 166 (0x1) lustre-MDT0001-m del lustre.qpool2 00000020:00000080:3.0:1789892649.947217:0:215176:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1789892649.947294:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215176:1876835055473664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892649.947320:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.947334:0:215176:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082145300 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.947353:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055473664 00000100:00100000:1.0:1789892649.947357:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055473664 00000100:00100000:1.0:1789892649.947378:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:1.0:1789892649.947382:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215176:x1876835055473664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892649.947438:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215176:x1876835055473664:12345-0@lo:502:llog_process_th.0 Request processed in 56us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.947444:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:3.0:1789892649.947463:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215176:1876835055473664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892649.947491:0:215176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215176:1876835055473792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892649.947529:0:215176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.947542:0:215176:0:(client.c:2702:ptlrpc_set_wait()) set ffff903089f3be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.947552:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055473792 00000100:00100000:1.0:1789892649.947556:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055473792 00000100:00100000:1.0:1789892649.947575:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:1.0:1789892649.947580:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215176:x1876835055473792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892649.947634:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:215176:x1876835055473792:12345-0@lo:502:llog_process_th.0 Request processed in 53us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.947640:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:3.0:1789892649.947649:0:215176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215176:1876835055473792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892649.947670:0:215176:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892649.947674:0:215176:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892649.947675:0:215176:0:(obd_config.c:1561:class_process_config()) marker 166 (0x2) lustre-MDT0001-m del lustre.qpool2 00000040:00080000:3.0:1789892649.947697:0:215176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 182 count 178 00000020:01000000:2.0:1789892649.947733:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 178-181 (rc=0) 10000000:01000000:2.0:1789892649.947754:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892649.947760:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.947767:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892649.947773:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892649.947775:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 156 10000000:01000000:2.0:1789892649.947777:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892649.947803:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.947811:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.947820:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892649.947835:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055473920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.947866:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892649.947897:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055473920 00000100:00100000:2.0:1789892649.947898:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.947902:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055473920 00000100:00100000:0.0:1789892649.947927:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:0.0:1789892649.947932:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055473920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892649.947943:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892649.947951:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af238 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.947964:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.947970:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.947976:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99c00, rc 0) 00000100:00100000:0.0:1789892649.948003:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055473920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.948010:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:2.0:1789892649.948019:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055473920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892649.948032:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892649.948039:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892649.948077:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.948099:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.948112:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.948121:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055474048 00000100:00100000:0.0:1789892649.948125:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055474048 00000100:00100000:0.0:1789892649.948163:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:0.0:1789892649.948171:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055474048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892649.948243:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055474048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.948249:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1789892649.948275:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.948297:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.948327:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.948341:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.948358:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055474176 00000100:00100000:1.0:1789892649.948363:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055474176 00000100:00100000:1.0:1789892649.948383:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:1.0:1789892649.948388:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055474176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.948447:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055474176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.948454:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1789892649.948464:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892649.948661:0:215177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215177:1876835055474304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.948710:0:215177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.948731:0:215177:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318afedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.948741:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055474304 00000100:00100000:1.0:1789892649.948745:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055474304 00000100:00100000:1.0:1789892649.948766:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:1.0:1789892649.948770:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:215177:x1876835055474304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892649.948832:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:215177:x1876835055474304:12345-0@lo:502:llog_process_th.0 Request processed in 60us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.948839:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:2.0:1789892649.948848:0:215177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215177:1876835055474304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.948881:0:215177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215177:1876835055474432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892649.948908:0:215177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892649.948921:0:215177:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319882dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.948939:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055474432 00000100:00100000:0.0:1789892649.948943:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055474432 00000100:00100000:0.0:1789892649.948964:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:0.0:1789892649.948969:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:215177:x1876835055474432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.949029:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:215177:x1876835055474432:12345-0@lo:502:llog_process_th.0 Request processed in 59us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.949043:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:2.0:1789892649.949049:0:215177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215177:1876835055474432:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892649.949075:0:215177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:3.0:1789892649.949128:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:3.0:1789892649.949162:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892649.949169:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.949180:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892649.949202:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789892649.949204:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 178 10000000:01000000:3.0:1789892649.949207:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892649.949222:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.949230:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.949239:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.949253:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.949285:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.949304:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082145300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.949323:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055474560 00000100:00100000:0.0:1789892649.949327:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055474560 00000100:00100000:0.0:1789892649.949347:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:0.0:1789892649.949351:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055474560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892649.949357:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892649.949363:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af246 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.949375:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.949382:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892649.949387:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98200, rc 0) 00000100:00100000:0.0:1789892649.949412:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055474560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.949416:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1789892649.949449:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892649.949462:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.949472:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.949512:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.949542:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.949563:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082145300 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.949574:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055474688 00000100:00100000:1.0:1789892649.949579:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055474688 00000100:00100000:1.0:1789892649.949599:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:1.0:1789892649.949603:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055474688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.949655:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055474688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.949661:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:3.0:1789892649.949776:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.949863:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.949898:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892649.949928:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055474816 00000100:00100000:3.0:1789892649.949931:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082145300 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.949933:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055474816 00000100:00100000:1.0:1789892649.949957:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:1.0:1789892649.949962:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055474816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.950026:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055474816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.950034:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:3.0:1789892649.950039:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055474816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892649.950234:0:215178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215178:1876835055474944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892649.950269:0:215178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892649.950283:0:215178:0:(client.c:2702:ptlrpc_set_wait()) set ffff903184d2b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.950306:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055474944 00000100:00100000:0.0:1789892649.950310:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055474944 00000100:00100000:0.0:1789892649.950331:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1789892649.950336:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215178:x1876835055474944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.950410:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215178:x1876835055474944:12345-0@lo:502:llog_process_th.0 Request processed in 73us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892649.950416:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:1.0:1789892649.950421:0:215178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215178:1876835055474944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892649.950444:0:215178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892649.950452:0:215178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892649.950454:0:215178:0:(obd_config.c:1561:class_process_config()) marker 165 (0x1) lustre-MDT0000-m del lustre.qpool2 00000020:00000080:1.0:1789892649.950461:0:215178:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1789892649.951115:0:215178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215178:1876835055475072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892649.951156:0:215178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892649.951174:0:215178:0:(client.c:2702:ptlrpc_set_wait()) set ffff903184d2b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.951196:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055475072 00000100:00100000:0.0:1789892649.951205:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055475072 00000100:00100000:0.0:1789892649.951226:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:0.0:1789892649.951232:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215178:x1876835055475072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.951289:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215178:x1876835055475072:12345-0@lo:502:llog_process_th.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.951296:0:215178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215178:1876835055475072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892649.951297:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1789892649.951336:0:215178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215178:1876835055475200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892649.951372:0:215178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892649.951391:0:215178:0:(client.c:2702:ptlrpc_set_wait()) set ffff903184d2b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892649.951411:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055475200 00000100:00100000:3.0:1789892649.951417:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055475200 00000100:00100000:3.0:1789892649.951451:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:3.0:1789892649.951461:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215178:x1876835055475200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892649.951542:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:215178:x1876835055475200:12345-0@lo:502:llog_process_th.0 Request processed in 83us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.951554:0:215178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:215178:1876835055475200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892649.951555:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000020:01000000:1.0:1789892649.951575:0:215178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892649.951579:0:215178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892649.951581:0:215178:0:(obd_config.c:1561:class_process_config()) marker 165 (0x2) lustre-MDT0000-m del lustre.qpool2 00000040:00080000:1.0:1789892649.951585:0:215178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 182 count 178 00000020:01000000:3.0:1789892649.951628:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 178-181 (rc=0) 10000000:01000000:3.0:1789892649.951649:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892649.951656:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.951666:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892649.951676:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892649.951704:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:3.0:1789892649.951708:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892649.951724:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.951734:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.951755:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.951770:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055475328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.951800:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892649.951819:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055475328 00000100:00100000:1.0:1789892649.951824:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055475328 00000100:00100000:3.0:1789892649.951828:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082145300 going to sleep for 11 seconds 00000100:00100000:1.0:1789892649.951850:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:1.0:1789892649.951856:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055475328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892649.951863:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892649.951871:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af254 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.951893:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 24 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.951900:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 24 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892649.951907:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6800, rc 0) 00000100:00100000:1.0:1789892649.951944:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055475328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892649.951953:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:3.0:1789892649.951966:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055475328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892649.951978:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.951988:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892649.952025:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055475456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892649.952051:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892649.952068:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082145300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892649.952082:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055475456 00000100:00100000:0.0:1789892649.952086:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055475456 00000100:00100000:0.0:1789892649.952106:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:0.0:1789892649.952113:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055475456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892649.952176:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055475456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892649.952186:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:3.0:1789892649.952195:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055475456:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789892649.952222:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892649.952227:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892649.952235:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892650.065878:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892650.989556:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892650.989642:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062731520 00000100:00100000:2.0:1789892650.989654:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062731520 00000100:00080000:3.0:1789892650.989718:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892650.989760:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2774 00000100:00100000:2.0:1789892650.989771:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319dcddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214412:x1876835062731520:12345-192.168.203.53@tcp:101:rm.0 00010000:00010000:2.0:1789892650.989794:0:197539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892650.989824:0:197539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383000/0xd5b980e0d62af262 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26036e expref: -99 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.989894:0:197539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.989909:0:197539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.989921:0:197539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.989934:0:197539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.989939:0:197539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.989944:0:197539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990025:0:197539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383a00/0xd5b980e0d62af277 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990030:0:197539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383a00/0xd5b980e0d62af277 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990034:0:197539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383a00/0xd5b980e0d62af277 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789892650.990073:0:197539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00000004:00200000:2.0:1789892650.990077:0:197539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789892650.990095:0:197539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383a00/0xd5b980e0d62af277 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990111:0:197539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990117:0:197539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990123:0:197539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990127:0:197539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383800 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:2.0:1789892650.990130:0:197539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990152:0:197539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990175:0:197539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903186afbe00) 00010000:00010000:2.0:1789892650.990177:0:197539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892650.990181:0:197539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990187:0:197539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383800/0xd5b980e0d62af269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990195:0:197539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990199:0:197539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990206:0:197539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990219:0:197539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382800 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:2.0:1789892650.990223:0:197539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990230:0:197539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990241:0:197539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff903186afbf00) 00010000:00010000:2.0:1789892650.990244:0:197539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892650.990247:0:197539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990254:0:197539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382800/0xd5b980e0d62af270 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990300:0:197539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383000/0xd5b980e0d62af262 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26036e expref: 8 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990316:0:197539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383a00/0xd5b980e0d62af277 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26036e expref: 7 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892650.990325:0:197539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff903186afb300) 00010000:00010000:2.0:1789892650.990328:0:197539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789892650.990331:0:197539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383a00, rc 0) 00000100:00100000:2.0:1789892650.990397:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319dcddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+7:214412:x1876835062731520:12345-192.168.203.53@tcp:101:rm.0 Request processed in 629us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892650.990403:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2774 00000100:00100000:3.0:1789892650.991866:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892650.991917:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062731776 00000100:00100000:1.0:1789892650.991924:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062731776 00000100:00100000:1.0:1789892650.991959:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2775 00000100:00100000:1.0:1789892650.991967:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319dcdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+7:214412:x1876835062731776:12345-192.168.203.53@tcp:101:rm.0 00010000:00010000:1.0:1789892650.991975:0:190671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892650.991985:0:190671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260375 expref: -99 pid: 190671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789892650.992040:0:190671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00010000:00010000:1.0:1789892650.992159:0:190671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af27e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260375 expref: 9 pid: 190671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.992170:0:190671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903186afbe00) 00010000:00010000:1.0:1789892650.992174:0:190671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789892650.992178:0:190671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260375 expref: 9 pid: 190671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.992205:0:190671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892650.992244:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319dcdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+8:214412:x1876835062731776:12345-192.168.203.53@tcp:101:rm.0 Request processed in 278us (378us total) trans 12884904333 rc 301/301 00000100:00100000:1.0:1789892650.992252:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2775 00000100:00100000:3.0:1789892650.993793:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892650.993832:0:193007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062731904 00000100:00100000:0.0:1789892650.993838:0:193007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062731904 00000100:00100000:0.0:1789892650.993879:0:193007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 190 00000100:00100000:0.0:1789892650.993888:0:193007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903085c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+8:214412:x1876835062731904:12345-192.168.203.53@tcp:37:rm.0 00000100:00100000:0.0:1789892650.995591:0:193007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903085c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+8:214412:x1876835062731904:12345-192.168.203.53@tcp:37:rm.0 Request processed in 1703us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892650.995597:0:193007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 190 00000100:00100000:3.0:1789892650.996970:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892650.997045:0:194988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062732160 00000100:00100000:1.0:1789892650.997050:0:194988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062732160 00000100:00100000:1.0:1789892650.997081:0:194988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 191 00000100:00100000:1.0:1789892650.997087:0:194988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+8:214412:x1876835062732160:12345-192.168.203.53@tcp:35:rm.0 00000100:00100000:1.0:1789892650.997212:0:194988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+9:214412:x1876835062732160:12345-192.168.203.53@tcp:35:rm.0 Request processed in 125us (244us total) trans 12884904334 rc 0/0 00000100:00100000:1.0:1789892650.997218:0:194988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 191 00000100:00100000:3.0:1789892650.998017:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892650.998092:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062732416 00000100:00100000:1.0:1789892650.998097:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062732416 00000100:00100000:1.0:1789892650.998147:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2776 00000100:00100000:1.0:1789892650.998156:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+9:214412:x1876835062732416:12345-192.168.203.53@tcp:36:rm.0 00010000:00010000:1.0:1789892650.998199:0:192563:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789892650.998213:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383a00/0xd5b980e0d62af277 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26036e expref: 9 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998226:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff903186afb300) 00010000:00010000:1.0:1789892650.998235:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62aec81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2602e2 expref: 8 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998242:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903186afbe00) 00010000:00010000:1.0:1789892650.998253:0:192563:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892650.998266:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998273:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998279:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998286:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998292:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998296:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998338:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998343:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998347:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789892650.998520:0:192563:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00010000:00010000:1.0:1789892650.998529:0:192563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998534:0:192563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998544:0:192563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998549:0:192563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7800 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892650.998551:0:192563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998555:0:192563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998561:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff90309184e600) 00010000:00010000:1.0:1789892650.998563:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789892650.998565:0:192563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998569:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af29a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998581:0:192563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998586:0:192563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998590:0:192563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998593:0:192563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7e00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892650.998595:0:192563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998606:0:192563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998611:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90309184ec00) 00010000:00010000:1.0:1789892650.998613:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892650.998615:0:192563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998619:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af28c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789892650.998626:0:192563:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 000000008a9cb8fd reply state 00000000c06eb93e transno 12884904335 ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998635:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892650.998640:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff90309184ee00) 00010000:00010000:1.0:1789892650.998641:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789892650.998643:0:192563:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789892650.998697:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+9:214412:x1876835062732416:12345-192.168.203.53@tcp:36:rm.0 Request processed in 523us (662us total) trans 12884904335 rc 0/0 00000100:00100000:1.0:1789892650.998707:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2776 00000100:00100000:3.0:1789892650.999967:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892651.000006:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062732544 00000100:00100000:0.0:1789892651.000013:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062732544 00000100:00100000:0.0:1789892651.000051:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2777 00000100:00100000:0.0:1789892651.000059:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a285a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+9:212889:x1876835062732544:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1789892651.000069:0:190669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892651.000078:0:190669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26037c expref: -99 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892651.000118:0:190669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98c00/0xd5b980e0d62af2a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892651.000127:0:190669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98c00/0xd5b980e0d62af2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892651.000149:0:190669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98c00/0xd5b980e0d62af2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789892651.000170:0:190669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789892651.000172:0:190669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789892651.000183:0:190669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98c00/0xd5b980e0d62af2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892651.000196:0:190669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26037c expref: 11 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892651.000207:0:190669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98c00/0xd5b980e0d62af2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26037c expref: 10 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892651.000213:0:190669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90319363c000) 00010000:00010000:0.0:1789892651.000215:0:190669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789892651.000217:0:190669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98c00, rc 0) 00000100:00100000:0.0:1789892651.000245:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a285a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+10:212889:x1876835062732544:12345-192.168.203.53@tcp:101:bash.0 Request processed in 187us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892651.000250:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2777 00000100:00100000:3.0:1789892651.000922:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892651.000952:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062732672 00000100:00100000:1.0:1789892651.000957:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062732672 00000100:00100000:1.0:1789892651.000988:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2778 00000100:00100000:1.0:1789892651.000995:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+10:212889:x1876835062732672:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1789892651.001004:0:192197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892651.001012:0:192197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6400/0xd5b980e0d62af2af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260383 expref: -99 pid: 192197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001046:0:192197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001054:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001061:0:192197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001070:0:192197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001075:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001080:0:192197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001094:0:192197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001098:0:192197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001101:0:192197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001106:0:192197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6600 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892651.001108:0:192197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001120:0:192197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001126:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90319363c000) 00010000:00010000:1.0:1789892651.001128:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892651.001143:0:192197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001150:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af2b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001161:0:192197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001169:0:192197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001176:0:192197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001182:0:192197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6200 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892651.001185:0:192197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001192:0:192197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001212:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bd617dd (ffff90309184ef00) 00010000:00010000:1.0:1789892651.001215:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892651.001217:0:192197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001227:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af2bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001247:0:192197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6400/0xd5b980e0d62af2af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260383 expref: 11 pid: 192197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001253:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90319363c000) 00010000:00010000:1.0:1789892651.001255:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892651.001258:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6400/0xd5b980e0d62af2af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260383 expref: 11 pid: 192197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.001268:0:192197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6400, rc 0) 00000100:00100000:1.0:1789892651.001295:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+10:212889:x1876835062732672:12345-192.168.203.53@tcp:101:bash.0 Request processed in 301us (374us total) trans 0 rc 301/301 00000100:00100000:1.0:1789892651.001301:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2778 00000100:00100000:0.0:1789892651.025898:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055475584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892651.025972:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892651.026025:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055475584 00000100:00100000:1.0:1789892651.026034:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055475584 00000100:00100000:1.0:1789892651.026085:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789892651.026098:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055475584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892651.026147:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892651.026212:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055475584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892651.026222:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789892651.026251:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055475584:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789892651.089908:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892651.537841:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055475712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892651.537846:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055476224:0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.537938:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892651.537939:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892651.537993:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055476352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892651.537997:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055476736:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.538051:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892651.538053:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892651.538075:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055476864:0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.538084:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876835055477248:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.538106:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892651.538124:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892651.538150:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876835055477376:0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.538182:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055476224 00000100:00100000:1.0:1789892651.538184:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892651.538192:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055476224 00000100:00100000:1.0:1789892651.538225:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055475712 00000100:00100000:1.0:1789892651.538230:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055475712 00000100:00100000:2.0:1789892651.538267:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055476864 00000100:00100000:2.0:1789892651.538273:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055476864 00000100:00100000:1.0:1789892651.538279:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055476352 00000100:00100000:1.0:1789892651.538283:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055476352 00000100:00100000:3.0:1789892651.538315:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055475968:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.538321:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789892651.538322:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789892651.538336:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1876835055475712:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892651.538340:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055476224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.538368:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789892651.538379:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892651.538397:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055475968 00000100:00100000:0.0:1789892651.538402:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055475968 00000100:00100000:2.0:1789892651.538409:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055476224:12345-0@lo:400:kworker.0 Request processed in 73us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892651.538417:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055475840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892651.538419:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789892651.538440:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1876835055475712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892651.538444:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:2.0:1789892651.538450:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789892651.538455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892651.538456:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789892651.538461:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055475968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.538463:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1876835055476864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.538477:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055476480:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.538481:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055475840 00000100:00100000:1.0:1789892651.538486:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055475840 00000100:00100000:1.0:1789892651.538507:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789892651.538521:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055476864:12345-0@lo:400:kworker.0 Request processed in 58us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892651.538523:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055476352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892651.538526:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892651.538531:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055475968:12345-0@lo:400:kworker.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892651.538539:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789892651.538544:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00002000:00000024:1.0:1789892651.538550:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892651.538558:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055476480 00000100:00100000:2.0:1789892651.538563:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055476480 00000100:00100000:2.0:1789892651.538588:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789892651.538595:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876835055476480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.538628:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055476992:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.538649:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1876835055476352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892651.538652:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876835055476480:12345-0@lo:400:kworker.0 Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892651.538662:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789892651.538665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892651.538668:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789892651.538699:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876835055477504:0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.538715:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055476992 00000100:00100000:1.0:1789892651.538716:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789892651.538719:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055476992 00000100:00100000:3.0:1789892651.538726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892651.538729:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055475840:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892651.538740:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00002000:00000024:1.0:1789892651.538742:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892651.538749:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055476992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.538770:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055475968:0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.538787:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055476480:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.538803:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055475840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892651.538805:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055476992:0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.538809:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055476992:12345-0@lo:400:kworker.0 Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892651.538825:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789892651.538825:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789892651.538838:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789892651.538847:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055476096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892651.538857:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055476736 00000100:00100000:2.0:1789892651.538861:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055476736 00000100:00100000:1.0:1789892651.538872:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055477248 00000100:00100000:3.0:1789892651.538876:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892651.538879:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055477248 00000100:00100000:2.0:1789892651.538891:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055476096 00000100:00100000:2.0:1789892651.538896:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055476096 00000100:00100000:3.0:1789892651.538907:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876835055476608:0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.538916:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789892651.538921:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055477376 00000100:00100000:1.0:1789892651.538926:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055477376 00000100:00100000:2.0:1789892651.538929:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055476736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.538932:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892651.538952:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876835055477120:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.538953:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055477504 00000100:00100000:1.0:1789892651.538957:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055477504 00000100:00100000:1.0:1789892651.538978:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055476608 00000100:00100000:1.0:1789892651.538981:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055476608 00000100:00100000:2.0:1789892651.538997:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055476736:12345-0@lo:400:kworker.0 Request processed in 69us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892651.538999:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1789892651.539000:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892651.539016:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789892651.539016:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3620:x1876835055477248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.539017:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876835055477632:0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.539044:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789892651.539053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892651.539058:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055476096:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892651.539072:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3620:x1876835055477248:12345-0@lo:400:kworker.0 Request processed in 61us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892651.539078:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1789892651.539091:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055475840:0@lo:13:osp-pre-1-1.0 00000004:00000024:2.0:1789892651.539093:0:190693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1789892651.539096:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055477120 00000100:00100000:1.0:1789892651.539101:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055477120 00000100:00100000:1.0:1789892651.539120:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055477632 00000100:00100000:1.0:1789892651.539122:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055477632 00000100:00100000:3.0:1789892651.539151:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1789892651.539161:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876835055477376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.539168:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1789892651.539175:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055476096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892651.539182:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876835055477504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.539189:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789892651.539202:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876835055477376:12345-0@lo:400:kworker.0 Request processed in 42us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892651.539212:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789892651.539227:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876835055477504:12345-0@lo:400:kworker.0 Request processed in 50us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892651.539231:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1789892651.539242:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1789892651.539248:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876835055476608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.539252:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1789892651.539258:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876835055477120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.539272:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1789892651.539282:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a285b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876835055477632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.539316:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876835055476608:12345-0@lo:400:kworker.0 Request processed in 71us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892651.539318:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876835055477120:12345-0@lo:400:kworker.0 Request processed in 65us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892651.539329:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a285b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876835055477632:12345-0@lo:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892651.539335:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1789892651.539343:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1789892651.539359:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00080000:2.0:1789892651.539390:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789892651.539398:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789892651.539402:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789892651.539406:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789892651.539471:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055476736:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.539484:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055476352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892651.539495:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1876835055477248:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.539507:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055476864:0@lo:400:kworker.0 00000100:00100000:2.0:1789892651.539522:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055476224:0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.539523:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055476096:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789892651.539529:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff903084f2ad80 x1876835055477376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892651.539541:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876835055477376:0@lo:400:kworker.0 00000100:00100000:1.0:1789892651.539565:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055475712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892651.539570:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876835055476608:0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.539599:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876835055477120:0@lo:400:kworker.0 00010000:00080000:3.0:1789892651.539610:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9030a1cf9500 x1876835055477632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892651.539618:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876835055477632:0@lo:400:kworker.0 00000100:00100000:3.0:1789892651.539634:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876835055477504:0@lo:400:kworker.0 00000001:00080000:3.0:1789892651.540046:0:190650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904335 is committed 00010000:00010000:1.0:1789892651.540120:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.540148:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.540167:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.540173:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7400 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892651.540177:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.540184:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.540203:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff90309184ee00) 00010000:00010000:1.0:1789892651.540205:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892651.540209:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892651.540225:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af293 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1789892652.082702:0:215403:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789892652.082711:0:215403:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1789892652.092919:0:215408:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789892652.092930:0:215408:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789892652.114795:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789892652.947268:0:215516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3343201585304ns, next at 3261060696520ns, rc = 0 00080000:00080000:0.0:1789892652.947287:0:215516:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789892652.947390:0:215516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3343201710169ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789892652.947407:0:215516:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789892652.947470:0:215516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3343201789701ns, next at 3187969760152ns, rc = 0 00080000:00080000:0.0:1789892652.947476:0:215516:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789892652.947549:0:215516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3343201869644ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789892652.947556:0:215516:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789892652.948078:0:191400:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 35 committed 00000004:00080000:3.0:1789892652.948091:0:190650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 43 committed 00000004:00080000:1.0:1789892652.948501:0:191400:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 35 committed 00000004:00080000:3.0:1789892652.948577:0:190650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 41 committed 00000100:00100000:2.0:1789892653.073884:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a285b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055477760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892653.073996:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892653.074044:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055477760 00000100:00100000:1.0:1789892653.074056:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055477760 00000100:00080000:2.0:1789892653.074096:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892653.074144:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789892653.074175:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055477760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789892653.074224:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892653.074301:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055477760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892653.074313:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789892653.074372:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a285b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055477760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789892653.137816:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892653.523167:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892653.523218:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062732800 00000100:00100000:0.0:1789892653.523232:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062732800 00000100:00080000:2.0:1789892653.523295:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892653.523313:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2779 00000100:00100000:0.0:1789892653.523325:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214737:x1876835062732800:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:2.0:1789892653.525050:0:190671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055477888:0@lo:106: 00000100:00100000:2.0:1789892653.525133:0:190671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892653.525168:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055477888 00000100:00100000:3.0:1789892653.525175:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055477888 00000100:00100000:2.0:1789892653.525199:0:190671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055478016:0@lo:106: 00000100:00100000:3.0:1789892653.525229:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789892653.525238:0:190671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892653.525245:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:190671:x1876835055477888:12345-0@lo:106: 00000100:00100000:0.0:1789892653.525256:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055478016 00000100:00100000:0.0:1789892653.525261:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055478016 00010000:00010000:3.0:1789892653.525264:0:190653:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9030a3134200/0xd5b980e0d62aa74c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa761 expref: -99 pid: 193003 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892653.525279:0:190671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055478144:0@lo:106: 00010000:00010000:3.0:1789892653.525280:0:190653:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9030a3134200/0xd5b980e0d62aa74c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa761 expref: -99 pid: 193003 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892653.525297:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1789892653.525306:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a1d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:190671:x1876835055478016:12345-0@lo:106: 00000100:00100000:2.0:1789892653.525315:0:190671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892653.525316:0:191419:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff90309213f600/0xd5b980e0d62aa5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa5b6 expref: -99 pid: 192199 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892653.525330:0:191419:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff90309213f600/0xd5b980e0d62aa5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa5b6 expref: -99 pid: 192199 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892653.525344:0:190671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055478272:0@lo:106: 00000100:00100000:3.0:1789892653.525367:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:190671:x1876835055477888:12345-0@lo:106: Request processed in 127us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.525379:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789892653.525386:0:190671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892653.525395:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a1d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:190671:x1876835055478016:12345-0@lo:106: Request processed in 89us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.525405:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055478144 00000100:00100000:2.0:1789892653.525405:0:190671:0:(client.c:2702:ptlrpc_set_wait()) set ffff903198b74780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892653.525412:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055478144 00000100:00100000:0.0:1789892653.525412:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789892653.525442:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055478272 00000100:00100000:2.0:1789892653.525443:0:190671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055477888:0@lo:106: 00000100:00100000:3.0:1789892653.525448:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055478272 00000100:00100000:2.0:1789892653.525465:0:190671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055478016:0@lo:106: 00000100:00100000:3.0:1789892653.525483:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1789892653.525492:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789892653.525497:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:190671:x1876835055478144:12345-0@lo:106: 00000100:00100000:0.0:1789892653.525505:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:190671:x1876835055478272:12345-0@lo:106: 00010000:00010000:3.0:1789892653.525508:0:190653:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff90309265e000/0xd5b980e0d62aa4ba lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa4dd expref: -99 pid: 191422 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892653.525515:0:191419:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9030835cae00/0xd5b980e0d62aa386 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa443 expref: -99 pid: 190705 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892653.525521:0:190653:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff90309265e000/0xd5b980e0d62aa4ba lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa4dd expref: -99 pid: 191422 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892653.525523:0:191419:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9030835cae00/0xd5b980e0d62aa386 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa443 expref: -99 pid: 190705 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892653.525573:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:190671:x1876835055478272:12345-0@lo:106: Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892653.525580:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789892653.525602:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:190671:x1876835055478144:12345-0@lo:106: Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.525611:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1789892653.525839:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055478656:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892653.525882:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892653.525906:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a285b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876835055478528:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892653.525939:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a285b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055478400:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892653.525957:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892653.525979:0:190673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055478656 00000100:00100000:0.0:1789892653.525983:0:190673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055478656 00000100:00100000:3.0:1789892653.525997:0:191408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055478528 00000100:00100000:3.0:1789892653.526004:0:191408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055478528 00000100:00100000:0.0:1789892653.526019:0:190673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789892653.526020:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876835055478784:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892653.526027:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892653.526031:0:190673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055478656:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892653.526044:0:191408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055478400 00000100:00100000:3.0:1789892653.526050:0:191408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055478400 00000100:00100000:2.0:1789892653.526060:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892653.526077:0:194988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055478784 00000100:00100000:1.0:1789892653.526083:0:194988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055478784 00000100:00100000:3.0:1789892653.526086:0:191408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789892653.526095:0:190673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+12:3619:x1876835055478656:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.526102:0:191408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+12:3618:x1876835055478528:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892653.526107:0:190672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789892653.526133:0:190673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789892653.526139:0:190672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+12:3621:x1876835055478400:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789892653.526143:0:194988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789892653.526154:0:194988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876835055478784:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892653.526192:0:191408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+12:3618:x1876835055478528:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892653.526195:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055478656:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892653.526206:0:190672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+12:3621:x1876835055478400:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 69us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892653.526206:0:194988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876835055478784:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.526213:0:191408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789892653.526223:0:194988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789892653.526229:0:190672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789892653.526251:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a285b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055478400:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892653.526278:0:190671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055478144:0@lo:106: 00000100:00100000:1.0:1789892653.526278:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876835055478784:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892653.526291:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a285b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876835055478528:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892653.526298:0:190671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055478272:0@lo:106: 00000100:00100000:2.0:1789892653.526388:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214737:x1876835062732800:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 3065us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892653.526397:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2779 00000100:00100000:1.0:1789892653.539533:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892653.539598:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062732928 00000100:00100000:3.0:1789892653.539612:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062732928 00000100:00100000:3.0:1789892653.539711:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2780 00000100:00100000:3.0:1789892653.539726:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214740:x1876835062732928:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892653.541295:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214740:x1876835062732928:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1573us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.541305:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2780 00000100:00100000:0.0:1789892653.555320:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892653.555360:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062733056 00000100:00100000:0.0:1789892653.555374:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062733056 00000100:00100000:0.0:1789892653.555451:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2781 00000100:00100000:0.0:1789892653.555467:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214743:x1876835062733056:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:0.0:1789892653.557484:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214743:x1876835062733056:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 2021us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892653.557496:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2781 00000100:00100000:0.0:1789892653.579559:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892653.579621:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062733184 00000100:00100000:3.0:1789892653.579636:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062733184 00000100:00100000:3.0:1789892653.579745:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2782 00000100:00100000:3.0:1789892653.579760:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214746:x1876835062733184:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892653.581836:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214746:x1876835062733184:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 2079us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.581860:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2782 00000100:00100000:1.0:1789892653.595618:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892653.595719:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062733312 00000100:00100000:0.0:1789892653.595730:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062733312 00000100:00100000:0.0:1789892653.595793:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2783 00000100:00100000:0.0:1789892653.595803:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214749:x1876835062733312:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:1.0:1789892653.597801:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214749:x1876835062733312:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1996us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892653.597823:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2783 00000100:00100000:0.0:1789892653.604254:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892653.604302:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062733440 00000100:00100000:1.0:1789892653.604308:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062733440 00000100:00100000:1.0:1789892653.604344:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2784 00000100:00100000:1.0:1789892653.604352:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214750:x1876835062733440:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:1.0:1789892653.605853:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214750:x1876835062733440:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1501us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892653.605859:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2784 00000100:00100000:0.0:1789892653.611574:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892653.611634:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062733568 00000100:00100000:2.0:1789892653.611641:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062733568 00000100:00100000:3.0:1789892653.611716:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2785 00000100:00100000:3.0:1789892653.611727:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214751:x1876835062733568:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892653.613131:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214751:x1876835062733568:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1405us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.613140:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2785 00000100:00100000:3.0:1789892653.618874:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892653.618939:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062733696 00000100:00100000:1.0:1789892653.618944:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062733696 00000100:00100000:1.0:1789892653.618978:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2786 00000100:00100000:1.0:1789892653.618985:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a285b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214752:x1876835062733696:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:1.0:1789892653.620346:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a285b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:214752:x1876835062733696:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1359us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892653.620355:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2786 00000100:00100000:0.0:1789892653.755791:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892653.755872:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062733952 00000100:00100000:1.0:1789892653.755887:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062733952 00000100:00100000:0.0:1789892653.755887:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892653.755953:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062733824 00000100:00100000:3.0:1789892653.755960:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062733824 00000100:00080000:2.0:1789892653.755974:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892653.756008:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 464 00000100:00100000:3.0:1789892653.756016:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2001 00000100:00100000:3.0:1789892653.756040:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062733824:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892653.756041:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2396:x1876835062733952:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1789892653.756175:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062733824:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 146us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892653.756178:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2396:x1876835062733952:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 150us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892653.756202:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2001 00000100:00100000:1.0:1789892653.756205:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 464 00010000:00010000:2.0:1789892654.161917:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892655.185913:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789892655.480968:0:215612:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 04:24:14 (1789892654) 00000100:00100000:0.0:1789892656.145959:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055478912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892656.146047:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892656.146108:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055478912 00000100:00100000:2.0:1789892656.146117:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055478912 00000100:00100000:2.0:1789892656.146178:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789892656.146190:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055478912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789892656.146235:0:190693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789892656.146301:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055478912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892656.146312:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789892656.146348:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055478912:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789892656.210850:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892656.657860:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055479040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892656.657938:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892656.657992:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789892656.657999:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055479168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892656.658044:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892656.658075:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055479296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892656.658115:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892656.658173:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055479040 00000100:00100000:1.0:1789892656.658180:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055479040 00000100:00100000:1.0:1789892656.658231:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055479296 00000100:00100000:1.0:1789892656.658234:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055479296 00000100:00100000:1.0:1789892656.658260:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789892656.658268:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055479040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789892656.658294:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892656.658339:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055479040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892656.658346:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789892656.658367:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789892656.658373:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055479296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789892656.658387:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789892656.658401:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789892656.658409:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892656.658413:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055479296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892656.658418:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789892656.658428:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055479168 00000100:00100000:1.0:1789892656.658439:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a285b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055479424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892656.658464:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892656.658501:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055479424 00000100:00100000:1.0:1789892656.658504:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055479424 00000100:00100000:3.0:1789892656.658539:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055479168 00000100:00100000:1.0:1789892656.658547:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789892656.658556:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055479424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789892656.658568:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892656.658577:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789892656.658589:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055479168:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892656.658604:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055479424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000004:00000024:3.0:1789892656.658612:0:190675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1789892656.658612:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:1.0:1789892656.658633:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789892656.658666:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a285b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055479424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892656.658668:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055479168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892656.658711:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789892656.658756:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055479296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892656.658791:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055479168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892656.658802:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055479040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892656.658930:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055479552:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.658961:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892656.658974:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055479680:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659006:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055480064:0@lo:400:kworker.0 00000100:00100000:3.0:1789892656.659039:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892656.659045:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892656.659081:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876835055480192:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659090:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876835055479808:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659158:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892656.659181:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055480320:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659208:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892656.659235:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789892656.659242:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876835055479936:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659263:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892656.659286:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055479680 00000100:00100000:3.0:1789892656.659293:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055479680 00000100:00100000:1.0:1789892656.659295:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876835055480448:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659333:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892656.659353:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789892656.659366:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a285b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055479680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659371:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055479552 00000100:00100000:1.0:1789892656.659376:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055479552 00000100:00100000:1.0:1789892656.659406:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:1.0:1789892656.659416:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055479552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892656.659422:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a285b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055479680:12345-0@lo:400:kworker.0 Request processed in 58us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892656.659431:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789892656.659461:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055479552:12345-0@lo:400:kworker.0 Request processed in 47us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892656.659468:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:3.0:1789892656.659484:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055480064 00000100:00100000:3.0:1789892656.659488:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055480064 00000100:00080000:1.0:1789892656.659499:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789892656.659505:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892656.659524:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055479808 00000100:00100000:1.0:1789892656.659527:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055480320 00000100:00100000:3.0:1789892656.659528:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055479808 00000100:00100000:1.0:1789892656.659533:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055480320 00000100:00100000:3.0:1789892656.659547:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055479936 00000100:00100000:3.0:1789892656.659551:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055479936 00000100:00100000:1.0:1789892656.659569:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055480448 00000100:00100000:1.0:1789892656.659574:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055480448 00000100:00100000:3.0:1789892656.659579:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1789892656.659589:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055480064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659602:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1789892656.659612:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876835055479808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892656.659628:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055480064:12345-0@lo:400:kworker.0 Request processed in 41us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892656.659635:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1789892656.659657:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1789892656.659663:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876835055479808:12345-0@lo:400:kworker.0 Request processed in 52us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892656.659668:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055480320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659673:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1789892656.659724:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1789892656.659735:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876835055479936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892656.659741:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055480320:12345-0@lo:400:kworker.0 Request processed in 74us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892656.659748:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1789892656.659771:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1789892656.659782:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876835055479936:12345-0@lo:400:kworker.0 Request processed in 50us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892656.659789:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876835055480448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659795:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00080000:1.0:1789892656.659823:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789892656.659827:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892656.659835:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876835055480448:12345-0@lo:400:kworker.0 Request processed in 51us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892656.659843:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1789892656.659851:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055479552:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659879:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055480064:0@lo:400:kworker.0 00000100:00100000:3.0:1789892656.659886:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892656.659914:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055480192 00000100:00100000:1.0:1789892656.659918:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055480192 00000100:00100000:3.0:1789892656.659938:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055479680:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.659959:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1789892656.659968:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876835055480192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892656.660015:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876835055479936:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.660019:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876835055480192:12345-0@lo:400:kworker.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892656.660030:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00010000:00080000:3.0:1789892656.660047:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9031bfb0a680 x1876835055480448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789892656.660053:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892656.660060:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876835055480448:0@lo:400:kworker.0 00010000:00080000:1.0:1789892656.660081:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9031bfb08a80 x1876835055480192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892656.660082:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876835055479808:0@lo:400:kworker.0 00000100:00100000:1.0:1789892656.660111:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876835055480192:0@lo:400:kworker.0 00000100:00100000:3.0:1789892656.660119:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055480320:0@lo:400:kworker.0 00000020:00000004:2.0:1789892656.766831:0:215791:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789892656.766838:0:215791:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:1.0:1789892656.771905:0:215794:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789892656.771913:0:215794:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789892656.787904:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892656.787941:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062734080 00000100:00100000:0.0:1789892656.787948:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062734080 00000100:00080000:1.0:1789892656.788013:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892656.788039:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2787 00000100:00100000:0.0:1789892656.788050:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215046:x1876835062734080:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1789892656.788068:0:192563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892656.788088:0:192563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af2c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26038a expref: -99 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788177:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788189:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788202:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788219:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788225:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788230:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788275:0:192563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788280:0:192563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788285:0:192563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788290:0:192563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98800 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:0.0:1789892656.788293:0:192563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788300:0:192563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788318:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90319363c000) 00010000:00010000:0.0:1789892656.788320:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892656.788324:0:192563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788345:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98800/0xd5b980e0d62af2cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788357:0:192563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788361:0:192563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788366:0:192563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788376:0:192563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98600 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:0.0:1789892656.788379:0:192563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788384:0:192563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788396:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff90319363c100) 00010000:00010000:0.0:1789892656.788398:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892656.788400:0:192563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788404:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af2d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788437:0:192563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af2c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26038a expref: 7 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788445:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90319363c000) 00010000:00010000:0.0:1789892656.788447:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892656.788450:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af2c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26038a expref: 7 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.788457:0:192563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99400, rc 0) 00000100:00100000:0.0:1789892656.788503:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215046:x1876835062734080:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 456us (609us total) trans 0 rc 301/301 00000100:00100000:0.0:1789892656.788509:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2787 00000100:00100000:3.0:1789892656.790478:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892656.790541:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062734336 00000100:00100000:2.0:1789892656.790548:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062734336 00000100:00100000:2.0:1789892656.790585:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2788 00000100:00100000:2.0:1789892656.790593:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215046:x1876835062734336:12345-192.168.203.53@tcp:36:lfs.0 00010000:00010000:2.0:1789892656.790624:0:190670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892656.790635:0:190670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98c00/0xd5b980e0d62af2a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26037c expref: 6 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.790650:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90319363c000) 00010000:00010000:2.0:1789892656.790656:0:190670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892656.790712:0:190670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.790721:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.790727:0:190670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.790739:0:190670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.790745:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.790752:0:190670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791280:0:190670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791292:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791309:0:190670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789892656.791324:0:190670:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000d43b27e4 reply state 00000000902aadf3 transno 12884904336 ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791337:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791344:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903186afb500) 00010000:00010000:2.0:1789892656.791349:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789892656.791353:0:190670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789892656.791357:0:190670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:2.0:1789892656.791366:0:190670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791374:0:190670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791380:0:190670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791384:0:190670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382000 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:2.0:1789892656.791388:0:190670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791392:0:190670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791403:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903186afb200) 00010000:00010000:2.0:1789892656.791406:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892656.791415:0:190670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791420:0:190670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382000/0xd5b980e0d62af2d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789892656.791432:0:190670:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000d43b27e4 reply state 00000000902aadf3 transno 12884904336 ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791438:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892656.791443:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff903186afb800) 00010000:00010000:2.0:1789892656.791445:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789892656.791446:0:190670:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789892656.791499:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+7:215046:x1876835062734336:12345-192.168.203.53@tcp:36:lfs.0 Request processed in 906us (1028us total) trans 12884904336 rc 0/0 00000100:00100000:2.0:1789892656.791505:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2788 00000100:00100000:1.0:1789892656.796597:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892656.796644:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062734464 00000100:00100000:3.0:1789892656.796654:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062734464 00000100:00100000:3.0:1789892656.796758:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2789 00000100:00100000:3.0:1789892656.796775:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+7:215047:x1876835062734464:12345-192.168.203.53@tcp:101:chmod.0 00010000:00010000:3.0:1789892656.796798:0:197539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892656.796821:0:197539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9da00/0xd5b980e0d62af2ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260391 expref: -99 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892656.796876:0:197539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c000/0xd5b980e0d62af2f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892656.796887:0:197539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c000/0xd5b980e0d62af2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892656.796905:0:197539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c000/0xd5b980e0d62af2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789892656.796968:0:197539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789892656.796972:0:197539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789892656.796994:0:197539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c000/0xd5b980e0d62af2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892656.797032:0:197539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9da00/0xd5b980e0d62af2ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260391 expref: 9 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892656.797062:0:197539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c000/0xd5b980e0d62af2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260391 expref: 8 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892656.797078:0:197539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903083213300) 00010000:00010000:3.0:1789892656.797083:0:197539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789892656.797088:0:197539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c000, rc 0) 00000100:00100000:3.0:1789892656.797199:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+8:215047:x1876835062734464:12345-192.168.203.53@tcp:101:chmod.0 Request processed in 431us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892656.797213:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2789 00000100:00100000:3.0:1789892656.798435:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892656.798507:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062734592 00000100:00100000:1.0:1789892656.798516:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062734592 00000100:00100000:1.0:1789892656.798583:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2790 00000100:00100000:1.0:1789892656.798603:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+8:215047:x1876835062734592:12345-192.168.203.53@tcp:101:chmod.0 00010000:00010000:1.0:1789892656.798621:0:192563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892656.798640:0:192563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af2fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260398 expref: -99 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798723:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798751:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798765:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798785:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798795:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798804:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798865:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af311 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798875:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af311 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798886:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af311 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789892656.798916:0:192563:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000004:00200000:1.0:1789892656.798922:0:192563:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789892656.798954:0:192563:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af311 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798966:0:192563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798986:0:192563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.798994:0:192563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799001:0:192563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6600 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892656.799006:0:192563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799015:0:192563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799029:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903083213300) 00010000:00010000:1.0:1789892656.799033:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892656.799038:0:192563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799045:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6600/0xd5b980e0d62af303 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799065:0:192563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799072:0:192563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799081:0:192563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799088:0:192563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7400 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892656.799119:0:192563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799129:0:192563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799142:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff903186afb800) 00010000:00010000:1.0:1789892656.799145:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892656.799149:0:192563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799156:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7400/0xd5b980e0d62af30a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799190:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7e00/0xd5b980e0d62af2fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260398 expref: 10 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799211:0:192563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af311 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260398 expref: 9 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892656.799222:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903186afb500) 00010000:00010000:1.0:1789892656.799225:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789892656.799228:0:192563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6200, rc 0) 00000100:00100000:1.0:1789892656.799282:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+9:215047:x1876835062734592:12345-192.168.203.53@tcp:101:chmod.0 Request processed in 685us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892656.799295:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2790 00000100:00100000:3.0:1789892656.800415:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892656.800468:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062734848 00000100:00100000:0.0:1789892656.800483:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062734848 00000100:00100000:0.0:1789892656.800521:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2791 00000100:00100000:0.0:1789892656.800532:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+9:215047:x1876835062734848:12345-192.168.203.53@tcp:36:chmod.0 00010000:00010000:0.0:1789892656.800557:0:190671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892656.800569:0:190671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6200/0xd5b980e0d62af311 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260398 expref: 9 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.800581:0:190671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903186afb500) 00010000:00010000:0.0:1789892656.800584:0:190671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892656.800594:0:190671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.800601:0:190671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.800607:0:190671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789892656.800950:0:190671:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000026ec3ccb reply state 00000000be6f920a transno 12884904337 ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.800960:0:190671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892656.800965:0:190671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903186afb500) 00010000:00010000:0.0:1789892656.800967:0:190671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789892656.800968:0:190671:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789892656.800972:0:190671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000100:00100000:0.0:1789892656.801017:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+10:215047:x1876835062734848:12345-192.168.203.53@tcp:36:chmod.0 Request processed in 489us (606us total) trans 12884904337 rc 0/0 00000100:00100000:0.0:1789892656.801032:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2791 00010000:00010000:1.0:1789892657.233885:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789892657.746452:0:215902:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd21eee770 20000000:00000080:3.0:1789892657.746469:0:215902:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90309190c800 uarg=0000000000000000 20000000:01000000:3.0:1789892657.746512:0:215902:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789892657.746515:0:215902:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789892657.746518:0:215902:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=ugp' 20000000:01000000:3.0:1789892657.746523:0:215902:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'quota.ost=ugp' 20000000:01000000:3.0:1789892657.746535:0:215902:0:(mgs_llog.c:4246:mgs_write_log_quota()) global 'quota.ost=ugp' 20000000:01000000:3.0:1789892657.746599:0:215902:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789892657.746602:0:215902:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/quota.ost fl=4 20000000:01000000:3.0:1789892657.747190:0:215903:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 148 marker 133 1->4: lustre quota.ost 20000000:01000000:3.0:1789892657.747261:0:215903:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 150 marker 133 2->4: lustre quota.ost 00000040:00080000:3.0:1789892657.747290:0:215903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 182 count 178 00000040:00080000:0.0:1789892657.747459:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].182, 224 off41408 00000040:00080000:0.0:1789892657.747490:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].183, 88 off41496 00000040:00080000:0.0:1789892657.747506:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].184, 224 off41720 20000000:01000000:0.0:1789892657.747519:0:215902:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789892657.747522:0:215902:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 20000000:01000000:0.0:1789892657.748035:0:215904:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 148 marker 134 1->4: lustre quota.ost 20000000:01000000:0.0:1789892657.748066:0:215904:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 150 marker 134 2->4: lustre quota.ost 00000040:00080000:0.0:1789892657.748136:0:215904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 182 count 178 00000040:00080000:3.0:1789892657.748292:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].182, 224 off41408 00000040:00080000:3.0:1789892657.748318:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].183, 88 off41496 00000040:00080000:3.0:1789892657.748334:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].184, 224 off41720 20000000:01000000:3.0:1789892657.748344:0:215902:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789892657.748346:0:215902:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 20000000:01000000:0.0:1789892657.748715:0:215905:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 32 marker 135 1->4: lustre quota.ost 20000000:01000000:0.0:1789892657.748749:0:215905:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 34 marker 135 2->4: lustre quota.ost 00000040:00080000:0.0:1789892657.748761:0:215905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 35 count 35 00000040:00080000:3.0:1789892657.748903:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14456 00000040:00080000:3.0:1789892657.748930:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 88 off14544 00000040:00080000:3.0:1789892657.748947:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 224 off14768 20000000:01000000:3.0:1789892657.748958:0:215902:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789892657.748960:0:215902:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 20000000:01000000:0.0:1789892657.749340:0:215906:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 35 marker 136 1->4: lustre quota.ost 20000000:01000000:0.0:1789892657.749368:0:215906:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 136 2->4: lustre quota.ost 00000040:00080000:0.0:1789892657.749380:0:215906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 38 count 38 00000040:00080000:3.0:1789892657.749492:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14984 00000040:00080000:3.0:1789892657.749515:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 88 off15072 00000040:00080000:3.0:1789892657.749533:0:215902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15296 10000000:01000000:3.0:1789892657.749545:0:215902:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789892657.749566:0:215902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749588:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749598:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749606:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749613:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749629:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749636:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749643:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749650:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749656:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749663:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749670:0:215902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749677:0:215902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749745:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749761:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 23 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.749808:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055480576:0@lo:104: 00000100:00100000:3.0:1789892657.749880:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892657.749948:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.749959:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 23 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.749970:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055480704:0@lo:104: 00000100:00100000:3.0:1789892657.750007:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892657.750029:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055480576 00010000:00010000:3.0:1789892657.750046:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.750049:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055480576 00010000:00010000:3.0:1789892657.750065:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 23 pid: 194990 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.750078:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055480832:0@lo:104: 00000100:00100000:3.0:1789892657.750171:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892657.750175:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055480704 00000100:00100000:0.0:1789892657.750189:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055480704 00000100:00100000:2.0:1789892657.750216:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055480832 00000100:00100000:2.0:1789892657.750226:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055480832 00000100:00100000:0.0:1789892657.750255:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00010000:00010000:3.0:1789892657.750261:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.750274:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789892657.750277:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215902:x1876835055480576:12345-0@lo:104: 00010000:00010000:3.0:1789892657.750282:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 23 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.750299:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.750302:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215902:x1876835055480704:12345-0@lo:104: 00000100:00100000:3.0:1789892657.750307:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055480960:0@lo:104: 00000100:00100000:2.0:1789892657.750323:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1789892657.750352:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215902:x1876835055480832:12345-0@lo:104: 00010000:00010000:1.0:1789892657.750354:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.750376:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892657.750395:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.750421:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892657.750429:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892657.750437:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215902:x1876835055480576:12345-0@lo:104: Request processed in 162us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892657.750455:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00010000:00010000:1.0:1789892657.750459:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892657.750475:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215902:x1876835055480704:12345-0@lo:104: Request processed in 184us (472us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892657.750481:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 23 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.750494:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789892657.750495:0:191419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789892657.750505:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055481088:0@lo:104: 00000100:00100000:0.0:1789892657.750520:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055480960 00000100:00100000:0.0:1789892657.750529:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055480960 00010000:00010000:2.0:1789892657.750553:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789892657.750578:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892657.750580:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215902:x1876835055480832:12345-0@lo:104: Request processed in 223us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892657.750594:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055481088 00000100:00100000:0.0:1789892657.750595:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1789892657.750604:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055481088 00010000:00010000:3.0:1789892657.750614:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.750616:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1789892657.750620:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bbb78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215902:x1876835055480960:12345-0@lo:104: 00010000:00010000:3.0:1789892657.750639:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 23 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.750657:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.750665:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055481216:0@lo:104: 00000100:00100000:1.0:1789892657.750668:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1789892657.750724:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215902:x1876835055481088:12345-0@lo:104: 00010000:00010000:1.0:1789892657.750739:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.750747:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892657.750759:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.750771:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892657.750777:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.750789:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892657.750800:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892657.750806:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892657.750818:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892657.750846:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215902:x1876835055481088:12345-0@lo:104: Request processed in 131us (286us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892657.750853:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789892657.750862:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789892657.750866:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bbb78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215902:x1876835055480960:12345-0@lo:104: Request processed in 253us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892657.750885:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00010000:00010000:2.0:1789892657.750891:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.750920:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892657.750951:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892657.750970:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.750991:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.751038:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789892657.751040:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9cc00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892657.751042:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af25b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.751053:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892657.751057:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.751074:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892657.751157:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383c00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892657.751158:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.751161:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1789892657.751172:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.751182:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.751194:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.751251:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383200 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892657.751253:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892657.751256:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892657.751267:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.751268:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 23 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892657.751305:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892657.751323:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.751341:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055481472:0@lo:104: 00010000:00010000:2.0:1789892657.751344:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.751354:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892657.751366:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892657.751410:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892657.751411:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789892657.751412:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.751419:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892657.751429:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892657.751437:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.751451:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.751464:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892657.751470:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.751475:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af24d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.751503:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 23 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.751508:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.751547:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892657.751550:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789892657.751558:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055481856:0@lo:104: 00010000:00010000:1.0:1789892657.751561:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.751574:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d400 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892657.751576:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892657.751588:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.751623:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892657.751630:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af23f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.751646:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af21c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af223 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.751648:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.751668:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.751686:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789892657.751731:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.751745:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892657.751757:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892657.751760:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892657.751762:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 23 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.751767:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892657.751775:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892657.751778:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892657.751793:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892657.751800:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055482112:0@lo:104: 00010000:00010000:1.0:1789892657.751804:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.751815:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892657.751816:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892657.751828:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.751842:0:215902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892657.751844:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d400/0xd5b980e0d62af22a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af231 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.751872:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055481216 00010000:00010000:1.0:1789892657.751874:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892657.751882:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892657.751885:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055481216 00010000:00010000:1.0:1789892657.751888:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892657.751898:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.751913:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 9 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.751924:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055481344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892657.751931:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055482368:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892657.751935:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055481472 00000100:00100000:2.0:1789892657.751945:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055481472 00000100:00100000:2.0:1789892657.751993:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055481856 00000100:00100000:2.0:1789892657.752000:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055481856 00000100:00100000:0.0:1789892657.752017:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055481728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892657.752046:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892657.752048:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055482112 00000100:00100000:2.0:1789892657.752057:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055482112 00000100:00100000:2.0:1789892657.752142:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789892657.752143:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055482240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892657.752163:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892657.752173:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:215902:x1876835055481216:12345-0@lo:104: 00010000:00010000:2.0:1789892657.752204:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.752213:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892657.752230:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789892657.752252:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055481984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892657.752260:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789892657.752274:0:215902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.752277:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055481600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892657.752301:0:215902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 9 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.752319:0:215902:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055482496:192.168.203.53@tcp:104: 00000100:00100000:0.0:1789892657.752330:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892657.752340:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892657.752358:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:215902:x1876835055481216:12345-0@lo:104: Request processed in 189us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892657.752367:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055481344 00000100:00100000:2.0:1789892657.752375:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789892657.752375:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055481344 00010000:00010000:1.0:1789892657.752419:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 24 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892657.752435:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055481728 00000100:00100000:2.0:1789892657.752445:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789892657.752448:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055481728 00000100:00100000:1.0:1789892657.752464:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055482240 00000100:00100000:1.0:1789892657.752472:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055482240 00000100:00100000:2.0:1789892657.752475:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215902:x1876835055481472:12345-0@lo:104: 00010000:00010000:0.0:1789892657.752490:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 26 pid: 194990 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.752495:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.752496:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 26 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.752550:0:215902:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892657.752586:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055480576:0@lo:104: 00000100:00100000:0.0:1789892657.752589:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055481984 00000100:00100000:1.0:1789892657.752598:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1789892657.752602:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055481984 00000100:00100000:3.0:1789892657.752608:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055480704:0@lo:104: 00010000:00010000:0.0:1789892657.752637:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 27 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.752639:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3618:x1876835055481344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892657.752646:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892657.752675:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:215902:x1876835055481472:12345-0@lo:104: Request processed in 210us (1278us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892657.752677:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892657.752691:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 27 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892657.752729:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1789892657.752731:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1789892657.752742:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055480832:0@lo:104: 00000100:00100000:0.0:1789892657.752750:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3620:x1876835055481728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892657.752770:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892657.752775:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00010000:00010000:1.0:1789892657.752780:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 27 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.752804:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 27 pid: 194990 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.752821:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215902:x1876835055481856:12345-0@lo:104: 00010000:00010000:2.0:1789892657.752862:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.752870:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af25b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af254 expref: 27 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.752875:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 27 pid: 194990 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.752950:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af23f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af238 expref: 26 pid: 194990 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.752956:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892657.752971:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892657.753015:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789892657.753034:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:215902:x1876835055481856:12345-0@lo:104: Request processed in 223us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892657.753056:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1789892657.753108:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055480960:0@lo:104: 00000100:00100000:1.0:1789892657.753155:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055481344:12345-0@lo:103:ldlm_bl.0 Request processed in 492us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892657.753162:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789892657.753165:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055481728:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892657.753189:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055481088:0@lo:104: 00000100:00100000:2.0:1789892657.753192:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:215902:x1876835055482112:12345-0@lo:104: 00000100:00100000:0.0:1789892657.753197:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1789892657.753217:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00010000:00010000:2.0:1789892657.753228:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.753230:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055481216:0@lo:104: 00000100:00100000:0.0:1789892657.753237:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1789892657.753265:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3618:x1876835055482240:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892657.753278:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055481472:0@lo:104: 00010000:00010000:0.0:1789892657.753280:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892657.753290:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 23 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.753304:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055481856:0@lo:104: 00010000:00010000:0.0:1789892657.753308:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 23 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.753328:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00010000:00010000:0.0:1789892657.753340:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af22a expref: 23 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.753341:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055482112:0@lo:104: 00000100:00100000:1.0:1789892657.753358:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055481984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892657.753361:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789892657.753373:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892657.753385:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:215902:x1876835055482112:12345-0@lo:104: Request processed in 196us (1548us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892657.753387:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892657.753420:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 22 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.753431:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789892657.753453:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3618:x1876835055482240:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (1243us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892657.753457:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 22 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892657.753477:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00010000:00010000:3.0:1789892657.753504:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892657.753504:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892657.753516:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af223 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af21c expref: 21 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.753522:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.753527:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.753571:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892657.753572:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382400 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892657.753582:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d000 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:0.0:1789892657.753592:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055481728:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789892657.753595:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.753622:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.753623:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055481984:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892657.753678:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1789892657.753679:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055481984:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789892657.753683:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892657.753708:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892657.753708:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892657.753739:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892657.753758:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892657.753767:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892657.753820:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.753836:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892657.753857:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892657.753864:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.753877:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af207 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.753883:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.753926:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892657.753954:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.753962:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055481344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892657.753977:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892657.753987:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892657.754000:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.754008:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9dc00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892657.754039:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382e00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892657.754040:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.754046:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055482240:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789892657.754049:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.754058:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.754079:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.754106:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789892657.754126:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.754150:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055482624:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789892657.754153:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.754163:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af20e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af215 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892657.754178:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892657.754191:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892657.754230:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789892657.754234:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892657.754243:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892657.754251:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892657.754253:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.754260:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892657.754271:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892657.754280:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789892657.754292:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.754297:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055481600 00000100:00100000:1.0:1789892657.754306:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055481600 00000100:00100000:2.0:1789892657.754312:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055482880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892657.754315:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af1f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1f9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.754335:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 20 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.754351:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.754361:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892657.754364:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892657.754374:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892657.754384:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892657.754387:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055482624 00000100:00100000:1.0:1789892657.754393:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055482624 00010000:00010000:3.0:1789892657.754395:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.754406:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af1e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af1eb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.754428:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 21 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.754445:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892657.754460:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892657.754463:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00010000:00010000:3.0:1789892657.754469:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892657.754473:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892657.754506:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055481600:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892657.754512:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055482880 00000100:00100000:1.0:1789892657.754524:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055482880 00000100:00100000:2.0:1789892657.754532:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055482752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892657.754536:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892657.754547:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 22 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.754552:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 22 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.754586:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 22 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.754604:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892657.754606:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1789892657.754634:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3618:x1876835055482624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892657.754643:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af24d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af246 expref: 22 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.754651:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892657.754663:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 22 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.754677:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055482752 00000100:00100000:2.0:1789892657.754683:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055482752 00010000:00010000:2.0:1789892657.754717:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 22 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.754730:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892657.754753:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 22 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.754772:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af200 expref: 22 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.754788:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892657.754845:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1789892657.754856:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892657.754879:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3621:x1876835055482880:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892657.754910:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055481600:12345-0@lo:103:ldlm_bl.0 Request processed in 400us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892657.754912:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055482624:12345-0@lo:103:ldlm_bl.0 Request processed in 281us (696us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892657.754920:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892657.754951:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 21 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.754987:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892657.754988:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00010000:00010000:2.0:1789892657.755008:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 21 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.755025:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00010000:00010000:3.0:1789892657.755026:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892657.755040:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6a00/0xd5b980e0d62af1f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af1f2 expref: 20 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892657.755062:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062735104 00010000:00010000:2.0:1789892657.755072:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892657.755074:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062734976 00000100:00100000:0.0:1789892657.755074:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062735104 00000100:00100000:1.0:1789892657.755102:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062734976 00000100:00100000:3.0:1789892657.755110:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055482368:192.168.203.53@tcp:104: 00000100:00100000:3.0:1789892657.755146:0:215902:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:215902:1876835055482496:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892657.755150:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 11 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.755152:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 11 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.755181:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3621:x1876835055482880:12345-0@lo:103:ldlm_bl.0 Request processed in 306us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892657.755218:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1789892657.755235:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789892657.755241:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3621:x1876835055482752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892657.755257:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892657.755257:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 474 00010000:00010000:1.0:1789892657.755280:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 18 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.755284:0:215902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892657.755302:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062734976:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892657.755304:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 17 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.755321:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 475 00010000:00010000:0.0:1789892657.755340:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892657.755365:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af215 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af20e expref: 17 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892657.755367:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062735104:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892657.755369:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 11 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.755402:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892657.755412:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892657.755416:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055482880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892657.755419:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 11 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892657.755430:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 11 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.755475:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789892657.755486:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3621:x1876835055482752:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892657.755494:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055483008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892657.755513:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00010000:00010000:2.0:1789892657.755535:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 11 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.755553:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892657.755576:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055483008 00000100:00100000:1.0:1789892657.755585:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055483008 00010000:00010000:0.0:1789892657.755593:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382600/0xd5b980e0d62af1dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260367 expref: 11 pid: 190662 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892657.755622:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af1d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260360 expref: 11 pid: 190663 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.755623:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 16 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.755651:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055482752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892657.755723:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892657.755737:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00010000:00010000:0.0:1789892657.755740:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892657.755758:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055483008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892657.755765:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055482624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892657.755777:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892657.755792:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 16 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892657.755799:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055481600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892657.755809:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2397:x1876835062735104:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 454us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892657.755819:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2397:x1876835062734976:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 518us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892657.755861:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 475 00010000:00010000:1.0:1789892657.755870:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 16 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892657.755882:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 474 00010000:00010000:1.0:1789892657.755911:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af1eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af1e4 expref: 16 pid: 190664 timeout: 3448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.755936:0:190657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.755950:0:190657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.755971:0:190657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.755983:0:190657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.756015:0:190657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.756027:0:190657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.756034:0:190657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9ca00 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:1.0:1789892657.756039:0:190657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.756047:0:190657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.756067:0:190657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892657.756080:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892657.756105:0:215902:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.756118:0:215902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892657.756127:0:215902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af31f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 215902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892657.756154:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055483008:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892657.756174:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789892657.756229:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055483008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892658.193882:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055483136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892658.193977:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892658.194035:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055483136 00000100:00100000:1.0:1789892658.194049:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055483136 00000100:00080000:2.0:1789892658.194151:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892658.194164:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789892658.194182:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055483136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789892658.194223:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892658.194304:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055483136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892658.194317:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789892658.194371:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055483136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789892658.257863:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892658.875628:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892658.875667:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892658.875752:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062735232 00000100:00100000:1.0:1789892658.875762:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062735232 00000100:00100000:3.0:1789892658.875771:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892658.875803:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062735360 00000100:00100000:2.0:1789892658.875813:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062735360 00000100:00100000:1.0:1789892658.875824:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2003 00000100:00100000:3.0:1789892658.875825:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892658.875845:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062735232:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892658.875862:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789892658.875865:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062735616 00000100:00100000:3.0:1789892658.875872:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062735616 00010000:00010000:1.0:1789892658.875882:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26039f expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892658.875911:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2004 00010000:00010000:1.0:1789892658.875912:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 10 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892658.875932:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 10 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892658.875934:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062735488 00000100:00100000:2.0:1789892658.875934:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062735360:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1789892658.875944:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062735488 00010000:00010000:1.0:1789892658.875954:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7200, rc 0) 00000100:00100000:3.0:1789892658.875985:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 471 00000100:00100000:3.0:1789892658.875996:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2397:x1876835062735616:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892658.876012:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062735232:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 171us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892658.876014:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062735360:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 84us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892658.876028:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2003 00000100:00100000:2.0:1789892658.876038:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2004 00000100:00100000:3.0:1789892658.876040:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2397:x1876835062735616:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 44us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892658.876052:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 471 00000100:00100000:1.0:1789892658.876096:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 472 00000100:00100000:1.0:1789892658.876108:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+10:2396:x1876835062735488:12345-192.168.203.53@tcp:400:kworker.0 00000100:00080000:3.0:1789892658.876126:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789892658.876134:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892658.876147:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+10:2396:x1876835062735488:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 41us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892658.876154:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 472 00000100:00100000:3.0:1789892658.877154:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892658.877196:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062735744 00000100:00100000:1.0:1789892658.877203:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062735744 00000100:00100000:1.0:1789892658.877241:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2005 00000100:00100000:1.0:1789892658.877250:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062735744:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892658.877418:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062735744:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 167us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892658.877425:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2005 00000100:00100000:2.0:1789892658.878254:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892658.878305:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062735872 00000100:00100000:1.0:1789892658.878312:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062735872 00000100:00100000:1.0:1789892658.878357:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2006 00000100:00100000:1.0:1789892658.878391:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062735872:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892658.878509:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062735872:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 140us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892658.878520:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2006 00000100:00100000:0.0:1789892658.880448:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892658.880505:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062736000 00000100:00100000:2.0:1789892658.880512:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062736000 00000100:00100000:2.0:1789892658.880551:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2007 00000100:00100000:2.0:1789892658.880562:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062736000:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892658.880572:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892658.880584:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603a6 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892658.880603:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892658.880630:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892658.880639:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383800, rc 0) 00000100:00100000:2.0:1789892658.880815:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062736000:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 116us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892658.880826:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2007 00000100:00100000:2.0:1789892658.881546:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892658.881615:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062736128 00000100:00100000:0.0:1789892658.881622:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062736128 00000100:00100000:0.0:1789892658.881672:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2008 00000100:00100000:0.0:1789892658.881693:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062736128:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892658.881747:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062736128:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 70us (203us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892658.881753:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2008 00010000:00010000:2.0:1789892659.281778:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789892659.690005:0:216146:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: User quota (block hardlimit:1000 MB) 00000100:00100000:0.0:1789892659.708181:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892659.708229:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062736256 00000100:00100000:3.0:1789892659.708240:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062736256 00000100:00100000:3.0:1789892659.708303:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2792 00000100:00100000:3.0:1789892659.708317:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+10:215323:x1876835062736256:12345-192.168.203.53@tcp:48:lfs.0 00000001:00080000:0.0:1789892659.709393:0:190650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904337 is committed 00010000:00010000:1.0:1789892659.709417:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709427:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709435:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709440:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382200 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892659.709444:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709450:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709463:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff903186afb800) 00010000:00010000:1.0:1789892659.709466:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892659.709477:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709482:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382200/0xd5b980e0d62af2e0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709499:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709504:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709508:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709512:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383600 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892659.709514:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709517:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709524:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903186afb500) 00010000:00010000:1.0:1789892659.709526:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892659.709528:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709532:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383600/0xd5b980e0d62af2e7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709541:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709554:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709559:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709563:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99400 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892659.709565:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709570:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709576:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903186afb500) 00010000:00010000:1.0:1789892659.709578:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789892659.709580:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.709583:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99400/0xd5b980e0d62af318 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.710156:0:190670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190670:1876835055483264:0@lo:106: 00000100:00100000:3.0:1789892659.710210:0:190670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892659.710239:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055483264 00000100:00100000:0.0:1789892659.710244:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055483264 00000100:00100000:3.0:1789892659.710275:0:190670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190670:1876835055483392:0@lo:106: 00000100:00100000:0.0:1789892659.710282:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1789892659.710290:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:190670:x1876835055483264:12345-0@lo:106: 00010000:00010000:0.0:1789892659.710300:0:194861:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9030a3134200/0xd5b980e0d62aa74c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa761 expref: -99 pid: 193003 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.710314:0:194861:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9030a3134200/0xd5b980e0d62aa74c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa761 expref: -99 pid: 193003 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.710324:0:190670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.710360:0:190670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190670:1876835055483520:0@lo:106: 00000100:00100000:0.0:1789892659.710375:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:190670:x1876835055483264:12345-0@lo:106: Request processed in 84us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892659.710385:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1789892659.710407:0:190670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190670:1876835055483648:0@lo:106: 00000100:00100000:0.0:1789892659.710417:0:194861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789892659.710441:0:194861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.710479:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055483392 00000100:00100000:0.0:1789892659.710483:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055483520 00000100:00100000:3.0:1789892659.710485:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055483392 00000100:00100000:0.0:1789892659.710490:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055483520 00000100:00100000:3.0:1789892659.710530:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1789892659.710539:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789892659.710545:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:190670:x1876835055483392:12345-0@lo:106: 00000100:00100000:0.0:1789892659.710552:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:190670:x1876835055483520:12345-0@lo:106: 00010000:00010000:0.0:1789892659.710569:0:194861:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff90309265e000/0xd5b980e0d62aa4ba lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa4dd expref: -99 pid: 191422 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.710572:0:190653:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff90309213f600/0xd5b980e0d62aa5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa5b6 expref: -99 pid: 192199 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.710587:0:194861:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff90309265e000/0xd5b980e0d62aa4ba lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa4dd expref: -99 pid: 191422 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.710592:0:190653:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff90309213f600/0xd5b980e0d62aa5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa5b6 expref: -99 pid: 192199 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892659.710633:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:190670:x1876835055483520:12345-0@lo:106: Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892659.710639:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789892659.710665:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:190670:x1876835055483392:12345-0@lo:106: Request processed in 123us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.710675:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1789892659.710921:0:190670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.710946:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055483648 00000100:00100000:1.0:1789892659.710952:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055483648 00000100:00100000:3.0:1789892659.710963:0:190670:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.710992:0:190670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190670:1876835055483264:0@lo:106: 00000100:00100000:1.0:1789892659.711011:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789892659.711012:0:190670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190670:1876835055483392:0@lo:106: 00000100:00100000:1.0:1789892659.711023:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:190670:x1876835055483648:12345-0@lo:106: 00000100:00100000:3.0:1789892659.711030:0:190670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190670:1876835055483520:0@lo:106: 00010000:00010000:1.0:1789892659.711032:0:190654:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9030835cae00/0xd5b980e0d62aa386 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa443 expref: -99 pid: 190705 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.711041:0:190654:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9030835cae00/0xd5b980e0d62aa386 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa443 expref: -99 pid: 190705 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.711122:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:190670:x1876835055483648:12345-0@lo:106: Request processed in 103us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.711128:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789892659.711323:0:190670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190670:1876835055483648:0@lo:106: 00000100:00100000:3.0:1789892659.711422:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215323:x1876835062736256:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 3108us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.711432:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2792 10000000:01000000:1.0:1789892659.729775:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892659.729780:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 159 10000000:01000000:1.0:1789892659.729784:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892659.729819:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.729829:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.729838:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.729859:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055483776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.729917:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.729965:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055483776 00000100:00100000:1.0:1789892659.729970:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.729975:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055483776 00000100:00100000:3.0:1789892659.730093:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:3.0:1789892659.730103:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055483776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892659.730116:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892659.730127:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af334 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.730158:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.730167:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.730174:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d800, rc 0) 00000100:00100000:3.0:1789892659.730215:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055483776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.730222:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:1.0:1789892659.730244:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055483776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892659.730257:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.730265:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.730323:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055483904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.730357:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.730382:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.730410:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055483904 00000100:00100000:3.0:1789892659.730415:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055483904 00000100:00100000:3.0:1789892659.730479:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1789892659.730489:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055483904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.730589:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055483904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.730596:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:1.0:1789892659.730607:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055483904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.730632:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.730665:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.730713:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.730726:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055484032 00000100:00100000:0.0:1789892659.730734:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055484032 00000100:00100000:0.0:1789892659.730771:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:0.0:1789892659.730782:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055484032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.730884:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055484032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.730896:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.730911:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000040:00080000:0.0:1789892659.731656:0:216157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 156 00000020:01000000:1.0:1789892659.731744:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-158 (rc=0) 10000000:01000000:1.0:1789892659.731771:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892659.731778:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.731785:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892659.731791:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892659.731793:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789892659.731794:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892659.731808:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.731813:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.731818:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.731829:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.731855:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.731881:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.731901:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055484160 00000100:00100000:0.0:1789892659.731907:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055484160 00000100:00100000:0.0:1789892659.731945:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:0.0:1789892659.731956:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055484160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892659.731965:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892659.731976:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af342 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.731995:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.732006:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.732015:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99c00, rc 0) 00000100:00100000:0.0:1789892659.732061:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055484160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892659.732084:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1789892659.732087:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892659.732104:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.732113:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.732158:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.732180:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.732197:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.732216:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055484288 00000100:00100000:3.0:1789892659.732221:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055484288 00000100:00100000:3.0:1789892659.732249:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:3.0:1789892659.732255:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055484288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.732327:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055484288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.732333:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:1.0:1789892659.732343:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.732370:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.732402:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.732421:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.732438:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055484416 00000100:00100000:3.0:1789892659.732442:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055484416 00000100:00100000:3.0:1789892659.732473:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:3.0:1789892659.732479:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055484416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.732547:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055484416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.732553:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1789892659.732559:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.732754:0:216158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216158:1876835055484544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892659.732787:0:216158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.732813:0:216158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030816329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892659.732817:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055484544 00000100:00100000:2.0:1789892659.732824:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055484544 00000100:00100000:2.0:1789892659.732863:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:2.0:1789892659.732874:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:216158:x1876835055484544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892659.732979:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:216158:x1876835055484544:12345-0@lo:502:llog_process_th.0 Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.732995:0:216158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216158:1876835055484544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892659.733005:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000020:01000000:3.0:1789892659.733021:0:216158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892659.733029:0:216158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892659.733030:0:216158:0:(obd_config.c:1561:class_process_config()) marker 169 (0x1) lustre quota.ost 00000020:00000080:3.0:1789892659.733036:0:216158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789892659.733054:0:216158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216158:1876835055484672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892659.733097:0:216158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.733112:0:216158:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a256480 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.733134:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055484672 00000100:00100000:1.0:1789892659.733139:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055484672 00000100:00100000:1.0:1789892659.733166:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1789892659.733173:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:216158:x1876835055484672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892659.733247:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:216158:x1876835055484672:12345-0@lo:502:llog_process_th.0 Request processed in 74us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.733253:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:3.0:1789892659.733259:0:216158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216158:1876835055484672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892659.733280:0:216158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892659.733285:0:216158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892659.733286:0:216158:0:(obd_config.c:1561:class_process_config()) marker 169 (0x2) lustre quota.ost 00000040:00080000:3.0:1789892659.733289:0:216158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 38 00000020:01000000:1.0:1789892659.733338:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-37 (rc=0) 10000000:01000000:1.0:1789892659.733360:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892659.733365:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.733376:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892659.733381:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892659.733383:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 159 10000000:01000000:1.0:1789892659.733384:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892659.733396:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.733402:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.733407:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.733417:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.733440:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.733458:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.733471:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055484800 00000100:00100000:3.0:1789892659.733476:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055484800 00000100:00100000:3.0:1789892659.733500:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:3.0:1789892659.733506:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055484800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892659.733511:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892659.733524:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af350 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.733537:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.733543:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.733548:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9ca00, rc 0) 00000100:00100000:3.0:1789892659.733581:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055484800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.733585:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:1.0:1789892659.733603:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892659.733613:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.733619:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.733647:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.733667:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.733719:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.733721:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055484928 00000100:00100000:3.0:1789892659.733725:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055484928 00000100:00100000:3.0:1789892659.733751:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1789892659.733757:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055484928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.733813:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055484928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.733818:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:1.0:1789892659.733821:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055484928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.733847:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.733878:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.733892:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892659.733915:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055485056 00000100:00100000:2.0:1789892659.733922:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055485056 00000100:00100000:2.0:1789892659.733959:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1789892659.733969:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055485056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892659.734059:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055485056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.734066:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892659.734085:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000040:00080000:2.0:1789892659.735029:0:216160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 156 00000020:01000000:1.0:1789892659.735098:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-158 (rc=0) 10000000:01000000:1.0:1789892659.735119:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892659.735126:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.735135:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892659.735142:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892659.735144:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:1.0:1789892659.735146:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892659.735160:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.735165:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.735170:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.735181:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.735210:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892659.735248:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055485184 00000100:00100000:1.0:1789892659.735250:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892659.735254:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055485184 00000100:00100000:2.0:1789892659.735299:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:2.0:1789892659.735311:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055485184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892659.735321:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892659.735332:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af35e expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892659.735350:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892659.735361:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892659.735369:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382800, rc 0) 00000100:00100000:2.0:1789892659.735412:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055485184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892659.735422:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1789892659.735433:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892659.735444:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.735450:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.735480:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.735501:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.735516:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.735524:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055485312 00000100:00100000:3.0:1789892659.735529:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055485312 00000100:00100000:3.0:1789892659.735553:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:3.0:1789892659.735559:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055485312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.735630:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055485312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.735636:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1789892659.735648:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.735668:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.735722:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.735745:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055485440 00000100:00100000:1.0:1789892659.735748:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.735755:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055485440 00000100:00100000:3.0:1789892659.735780:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1789892659.735786:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055485440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.735845:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055485440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.735851:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:1.0:1789892659.735860:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892659.736032:0:216161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216161:1876835055485568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892659.736065:0:216161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892659.736096:0:216161:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892659.736098:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055485568 00000100:00100000:3.0:1789892659.736102:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055485568 00000100:00100000:3.0:1789892659.736124:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1789892659.736130:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:216161:x1876835055485568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892659.736198:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:216161:x1876835055485568:12345-0@lo:502:llog_process_th.0 Request processed in 67us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.736204:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:2.0:1789892659.736213:0:216161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216161:1876835055485568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892659.736245:0:216161:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892659.736252:0:216161:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892659.736254:0:216161:0:(obd_config.c:1561:class_process_config()) marker 170 (0x1) lustre quota.ost 00000020:00000080:2.0:1789892659.736259:0:216161:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789892659.736282:0:216161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216161:1876835055485696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892659.736318:0:216161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892659.736337:0:216161:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.736354:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055485696 00000100:00100000:1.0:1789892659.736359:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055485696 00000100:00100000:1.0:1789892659.736384:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:1.0:1789892659.736390:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:216161:x1876835055485696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892659.736457:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:216161:x1876835055485696:12345-0@lo:502:llog_process_th.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.736465:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:2.0:1789892659.736473:0:216161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216161:1876835055485696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892659.736494:0:216161:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892659.736498:0:216161:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892659.736499:0:216161:0:(obd_config.c:1561:class_process_config()) marker 170 (0x2) lustre quota.ost 00000040:00080000:2.0:1789892659.736502:0:216161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 41 count 41 00000020:01000000:1.0:1789892659.736558:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-40 (rc=0) 10000000:01000000:1.0:1789892659.736591:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892659.736599:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.736613:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892659.736619:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892659.736621:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 159 10000000:01000000:1.0:1789892659.736622:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892659.736635:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.736641:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.736647:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.736657:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.736709:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.736750:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892659.737142:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055485824 00000100:00100000:2.0:1789892659.737147:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055485824 00000100:00100000:2.0:1789892659.737171:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:2.0:1789892659.737178:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055485824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892659.737185:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892659.737191:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af36c expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892659.737204:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892659.737213:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892659.737228:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383c00, rc 0) 00000100:00100000:2.0:1789892659.737272:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055485824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892659.737282:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:1.0:1789892659.737289:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892659.737304:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.737314:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.737355:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.737379:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.737402:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892659.737413:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055485952 00000100:00100000:2.0:1789892659.737419:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055485952 00000100:00100000:2.0:1789892659.737451:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:2.0:1789892659.737460:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055485952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892659.737526:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055485952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892659.737532:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:1.0:1789892659.737536:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055485952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.737562:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.737593:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.737609:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.737634:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055486080 00000100:00100000:0.0:1789892659.737641:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055486080 00000100:00100000:0.0:1789892659.737704:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1789892659.737716:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055486080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.737801:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055486080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892659.737810:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1789892659.737813:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892659.738522:0:216162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 156 00000020:01000000:1.0:1789892659.738877:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-158 (rc=0) 10000000:01000000:1.0:1789892659.738891:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892659.738896:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.738902:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892659.738909:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892659.738910:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 182 10000000:01000000:1.0:1789892659.738912:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892659.738926:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.738931:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.738937:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892659.738947:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.738973:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.739003:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.739017:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055486208 00000100:00100000:1.0:1789892659.739020:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055486208 00000100:00100000:1.0:1789892659.739053:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1789892659.739062:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055486208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892659.739067:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892659.739088:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af37a expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.739105:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.739114:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.739123:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7400, rc 0) 00000100:00100000:1.0:1789892659.739160:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055486208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.739166:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1789892659.739173:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892659.739187:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.739194:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.739229:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.739255:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.739271:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185800240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.739274:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055486336 00000100:00100000:1.0:1789892659.739278:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055486336 00000100:00100000:1.0:1789892659.739305:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1789892659.739314:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055486336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.739391:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055486336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.739396:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:3.0:1789892659.743047:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.743087:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.743125:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.743149:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.743166:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055486464 00000100:00100000:0.0:1789892659.743172:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055486464 00000100:00100000:0.0:1789892659.743208:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1789892659.743217:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055486464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.743310:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055486464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.743318:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.743322:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1789892659.743531:0:216164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216164:1876835055486592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892659.743583:0:216164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.743607:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055486592 00000100:00100000:0.0:1789892659.743608:0:216164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030810bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.743612:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055486592 00000100:00100000:1.0:1789892659.743638:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:1.0:1789892659.743650:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216164:x1876835055486592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892659.743753:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216164:x1876835055486592:12345-0@lo:502:llog_process_th.0 Request processed in 104us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.743761:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:0.0:1789892659.743778:0:216164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216164:1876835055486592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892659.743807:0:216164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892659.743815:0:216164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892659.743818:0:216164:0:(obd_config.c:1561:class_process_config()) marker 167 (0x1) lustre quota.ost 00000020:00000080:0.0:1789892659.743825:0:216164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789892659.743848:0:216164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216164:1876835055486720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892659.743891:0:216164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.743910:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055486720 00000100:00100000:1.0:1789892659.743914:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055486720 00000100:00100000:0.0:1789892659.743920:0:216164:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319cc973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.743941:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:1.0:1789892659.743949:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216164:x1876835055486720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892659.744016:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216164:x1876835055486720:12345-0@lo:502:llog_process_th.0 Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.744021:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1789892659.744040:0:216164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216164:1876835055486720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892659.744062:0:216164:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892659.744067:0:216164:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892659.744069:0:216164:0:(obd_config.c:1561:class_process_config()) marker 167 (0x2) lustre quota.ost 00000040:00080000:0.0:1789892659.744086:0:216164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 185 count 181 00000020:01000000:3.0:1789892659.744134:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 182-184 (rc=0) 10000000:01000000:3.0:1789892659.744153:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789892659.744159:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.744167:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892659.744174:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892659.744175:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 159 10000000:01000000:3.0:1789892659.744177:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892659.744190:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.744196:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.744202:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.744211:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.744233:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.744246:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.744257:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055486848 00000100:00100000:0.0:1789892659.744262:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055486848 00000100:00100000:0.0:1789892659.744291:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:0.0:1789892659.744300:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055486848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892659.744314:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892659.744324:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af388 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.744341:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.744351:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.744359:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98200, rc 0) 00000100:00100000:0.0:1789892659.744399:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055486848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892659.744408:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:3.0:1789892659.744416:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892659.744427:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.744440:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.744469:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.744489:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.744502:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.744512:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055486976 00000100:00100000:0.0:1789892659.744517:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055486976 00000100:00100000:0.0:1789892659.744543:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1789892659.744551:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055486976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.744629:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055486976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.744638:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055486976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.744639:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1789892659.744666:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.745258:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.745276:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.745285:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055487104 00000100:00100000:1.0:1789892659.745290:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055487104 00000100:00100000:1.0:1789892659.745315:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1789892659.745323:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055487104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.745387:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055487104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.745394:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1789892659.745400:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892659.746178:0:216165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 156 00000020:01000000:3.0:1789892659.746230:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-158 (rc=0) 10000000:01000000:3.0:1789892659.746248:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892659.746253:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.746259:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892659.746265:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789892659.746266:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 182 10000000:01000000:3.0:1789892659.746267:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892659.746278:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.746283:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.746295:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.746304:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.746325:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.746350:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.746376:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055487232 00000100:00100000:1.0:1789892659.746381:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055487232 00000100:00100000:1.0:1789892659.746409:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1789892659.746417:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055487232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892659.746425:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892659.746433:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af396 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.746461:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.746468:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892659.746474:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892659.746505:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055487232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.746512:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1789892659.746529:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892659.746541:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.746550:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.746586:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.746609:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.746626:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.746645:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055487360 00000100:00100000:0.0:1789892659.746650:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055487360 00000100:00100000:1.0:1789892659.746757:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:1.0:1789892659.746768:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055487360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892659.746841:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055487360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.746849:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:3.0:1789892659.746853:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.746877:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.746912:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.746935:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.746946:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055487488 00000100:00100000:0.0:1789892659.746951:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055487488 00000100:00100000:0.0:1789892659.746979:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:0.0:1789892659.746988:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055487488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.747083:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055487488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892659.747090:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.747097:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:0.0:1789892659.747268:0:216166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216166:1876835055487616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892659.747305:0:216166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892659.747324:0:216166:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.747328:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055487616 00000100:00100000:1.0:1789892659.747334:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055487616 00000100:00100000:1.0:1789892659.747360:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:1.0:1789892659.747368:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216166:x1876835055487616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892659.747443:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216166:x1876835055487616:12345-0@lo:502:llog_process_th.0 Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.747450:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1789892659.747459:0:216166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216166:1876835055487616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892659.747483:0:216166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892659.747489:0:216166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892659.747491:0:216166:0:(obd_config.c:1561:class_process_config()) marker 168 (0x1) lustre quota.ost 00000020:00000080:0.0:1789892659.747496:0:216166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789892659.747515:0:216166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216166:1876835055487744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892659.747551:0:216166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892659.747572:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055487744 00000100:00100000:0.0:1789892659.747573:0:216166:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892659.747576:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055487744 00000100:00100000:1.0:1789892659.747597:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1789892659.747602:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216166:x1876835055487744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892659.747658:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216166:x1876835055487744:12345-0@lo:502:llog_process_th.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892659.747664:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:0.0:1789892659.747672:0:216166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216166:1876835055487744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892659.747714:0:216166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892659.747719:0:216166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892659.747722:0:216166:0:(obd_config.c:1561:class_process_config()) marker 168 (0x2) lustre quota.ost 00000040:00080000:0.0:1789892659.747726:0:216166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 185 count 181 00000020:01000000:3.0:1789892659.747765:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 182-184 (rc=0) 10000000:01000000:3.0:1789892659.747787:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892659.747793:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.747809:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892659.747817:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892659.747819:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:3.0:1789892659.747822:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892659.747835:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.747844:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.747852:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.747865:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.747892:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892659.747920:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055487872 00000100:00100000:3.0:1789892659.747923:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.747926:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055487872 00000100:00100000:0.0:1789892659.747958:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1789892659.747965:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055487872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892659.747974:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892659.747984:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af3a4 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.748012:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.748021:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892659.748028:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892659.748064:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055487872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892659.748087:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:3.0:1789892659.748095:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055487872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892659.748105:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.748111:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892659.748137:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055488000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892659.748156:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892659.748175:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308647eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892659.748182:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055488000 00000100:00100000:0.0:1789892659.748187:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055488000 00000100:00100000:0.0:1789892659.748216:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1789892659.748223:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055488000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892659.748280:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055488000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892659.748288:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:3.0:1789892659.748292:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055488000:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789892659.748315:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892659.748319:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892659.748324:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789892660.015546:0:216203:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffeab90f130 20000000:00000080:0.0:1789892660.015559:0:216203:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9030837ee800 uarg=0000000000000000 00000040:00100000:0.0:1789892660.016157:0:216203:0:(llog.c:1072:llog_reverse_process()) index 158 : idx 137 20000000:01000000:0.0:1789892660.016164:0:216203:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 151 cmd:0xce023 lustre.qpool1 00000040:00080000:0.0:1789892660.016236:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].159, 224 off37176 20000000:01000000:0.0:1789892660.016256:0:216203:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892660.016274:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].160, 104 off37280 00000040:00080000:0.0:1789892660.016287:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].161, 224 off37504 00000040:00080000:0.0:1789892660.016328:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].185, 224 off41944 20000000:01000000:0.0:1789892660.016352:0:216203:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892660.016369:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].186, 112 off42056 00000040:00080000:0.0:1789892660.016379:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].187, 224 off42280 00000040:00080000:0.0:1789892660.016435:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].185, 224 off41944 20000000:01000000:0.0:1789892660.016441:0:216203:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:0.0:1789892660.016450:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].186, 112 off42056 00000040:00080000:0.0:1789892660.016459:0:216203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].187, 224 off42280 10000000:01000000:0.0:1789892660.016466:0:216203:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789892660.016497:0:216203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016513:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016520:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016525:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016530:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016534:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016538:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016543:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016563:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016572:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016576:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016580:0:216203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016585:0:216203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016614:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016625:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 23 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.016636:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488128:0@lo:104: 00000100:00100000:0.0:1789892660.016685:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892660.016735:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055488128 00000100:00100000:2.0:1789892660.016744:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055488128 00010000:00010000:0.0:1789892660.016745:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016754:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 23 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.016761:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488256:0@lo:104: 00000100:00100000:0.0:1789892660.016778:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892660.016789:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055488256 00000100:00100000:2.0:1789892660.016794:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055488256 00010000:00010000:0.0:1789892660.016801:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.016815:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 23 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892660.016816:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789892660.016830:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488384:0@lo:104: 00000100:00100000:1.0:1789892660.016831:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1789892660.016837:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055488128:12345-0@lo:104: 00000100:00100000:1.0:1789892660.016848:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055488256:12345-0@lo:104: 00010000:00010000:3.0:1789892660.016853:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.016858:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.016865:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892660.016890:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055488384 00010000:00010000:0.0:1789892660.016893:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.016896:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055488384 00010000:00010000:0.0:1789892660.016904:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 23 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.016912:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488512:0@lo:104: 00000100:00100000:2.0:1789892660.016927:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00010000:00010000:1.0:1789892660.016928:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789892660.016939:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892660.016939:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216203:x1876835055488256:12345-0@lo:104: Request processed in 95us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892660.016942:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216203:x1876835055488384:12345-0@lo:104: 00000100:00100000:3.0:1789892660.016949:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216203:x1876835055488128:12345-0@lo:104: Request processed in 119us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892660.016956:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892660.016959:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.016963:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1789892660.016972:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00010000:00010000:0.0:1789892660.016988:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892660.016995:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055488512 00000100:00100000:1.0:1789892660.016997:0:190654:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789892660.017002:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055488512 00010000:00010000:0.0:1789892660.017002:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 23 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017011:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892660.017015:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488640:0@lo:104: 00000100:00100000:2.0:1789892660.017021:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055488384:12345-0@lo:104: Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892660.017023:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789892660.017034:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1789892660.017036:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bad35050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055488512:12345-0@lo:104: 00010000:00010000:3.0:1789892660.017040:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789892660.017045:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017046:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892660.017050:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017066:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c400 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:2.0:1789892660.017066:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055488640 00000100:00100000:2.0:1789892660.017083:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055488640 10000000:00010000:3.0:1789892660.017084:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017096:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.017096:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.017104:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 23 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.017110:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00010000:00010000:1.0:1789892660.017111:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892660.017123:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bad35050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055488512:12345-0@lo:104: Request processed in 89us (173us total) trans 0 rc 0/0 10000000:00010000:3.0:1789892660.017124:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.017125:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055488640:12345-0@lo:104: 00000100:00100000:0.0:1789892660.017127:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488768:0@lo:104: 00000100:00100000:1.0:1789892660.017141:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:2.0:1789892660.017142:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892660.017146:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892660.017170:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892660.017183:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017183:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055488768 00000100:00100000:1.0:1789892660.017189:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055488768 00010000:00010000:3.0:1789892660.017196:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892660.017200:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017201:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789892660.017215:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055488640:12345-0@lo:104: Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892660.017215:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00010000:00010000:0.0:1789892660.017215:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 23 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017219:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017228:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055488768:12345-0@lo:104: 00000100:00100000:2.0:1789892660.017235:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00010000:00010000:3.0:1789892660.017243:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af39d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017250:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055489024:0@lo:104: 00010000:00010000:1.0:1789892660.017251:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017258:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892660.017258:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789892660.017267:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017267:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017277:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9da00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892660.017277:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892660.017281:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892660.017281:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017291:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017292:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017298:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892660.017300:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892660.017309:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216203:x1876835055488768:12345-0@lo:104: Request processed in 84us (141us total) trans 0 rc 0/0 10000000:00010000:3.0:1789892660.017311:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892660.017311:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017320:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 10000000:01000000:3.0:1789892660.017326:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789892660.017326:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892660.017329:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017338:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055489024 00010000:00010000:0.0:1789892660.017342:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 23 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017343:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055489024 00010000:00010000:2.0:1789892660.017347:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017351:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017358:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055489152:0@lo:104: 00010000:00010000:3.0:1789892660.017359:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892660.017359:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892660.017364:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00010000:00010000:3.0:1789892660.017373:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017377:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216203:x1876835055489024:12345-0@lo:104: 00010000:00010000:2.0:1789892660.017387:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017389:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892660.017390:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017394:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af38f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017406:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af3a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ab expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.017408:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017420:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892660.017428:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.017431:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 23 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017434:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789892660.017436:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892660.017443:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017445:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6400 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:1.0:1789892660.017448:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216203:x1876835055489024:12345-0@lo:104: Request processed in 73us (152us total) trans 0 rc 0/0 10000000:00010000:3.0:1789892660.017452:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017456:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055489536:0@lo:104: 00000100:00100000:1.0:1789892660.017468:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00010000:00010000:2.0:1789892660.017469:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892660.017473:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892660.017475:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017481:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055489152 10000000:00010000:3.0:1789892660.017483:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017483:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017486:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055489152 00000100:00100000:0.0:1789892660.017492:0:216203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789892660.017499:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1789892660.017501:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017502:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055489536 00000100:00100000:1.0:1789892660.017507:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055489536 10000000:01000000:2.0:1789892660.017509:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892660.017521:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.017522:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017530:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017532:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00010000:00010000:3.0:1789892660.017542:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892660.017545:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892660.017547:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 9 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017550:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055489152:12345-0@lo:104: 00010000:00010000:3.0:1789892660.017551:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017552:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.017568:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017570:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af36c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af373 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017584:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055489792:192.168.203.53@tcp:104: 00010000:00010000:3.0:1789892660.017596:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62af37a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af381 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017606:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892660.017607:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892660.017609:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017611:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017616:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892660.017618:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6e00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892660.017620:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892660.017621:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017629:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017630:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.017636:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789892660.017638:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892660.017639:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.017649:0:216203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892660.017651:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789892660.017651:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892660.017652:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216203:x1876835055489152:12345-0@lo:104: Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892660.017671:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00010000:00010000:0.0:1789892660.017673:0:216203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 9 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017676:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017676:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017711:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00010000:00010000:3.0:1789892660.017713:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892660.017718:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892660.017721:0:216203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055490048:192.168.203.53@tcp:104: 00010000:00010000:3.0:1789892660.017723:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.017725:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216203:x1876835055489536:12345-0@lo:104: 00010000:00010000:2.0:1789892660.017726:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.017741:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017743:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62af350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af357 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017743:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af35e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af365 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017751:0:216203:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a240 going to sleep for 11 seconds 00010000:00010000:3.0:1789892660.017768:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892660.017768:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892660.017771:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892660.017774:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488128:0@lo:104: 00010000:00010000:3.0:1789892660.017777:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.017777:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892660.017785:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892660.017789:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017791:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488256:0@lo:104: 00000100:00100000:2.0:1789892660.017793:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055489664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.017794:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892660.017807:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488384:0@lo:104: 00000100:00100000:1.0:1789892660.017808:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216203:x1876835055489536:12345-0@lo:104: Request processed in 83us (315us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892660.017809:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017819:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488512:0@lo:104: 00000100:00100000:1.0:1789892660.017825:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 10000000:00010000:3.0:1789892660.017834:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017838:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488640:0@lo:104: 00000100:00100000:2.0:1789892660.017843:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789892660.017849:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892660.017849:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892660.017855:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055488768:0@lo:104: 00010000:00010000:1.0:1789892660.017857:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.017864:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6c00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892660.017867:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017870:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055489024:0@lo:104: 00010000:00010000:3.0:1789892660.017872:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.017878:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:1.0:1789892660.017885:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.017886:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892660.017890:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055489152:0@lo:104: 00000100:00100000:2.0:1789892660.017891:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055489280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892660.017897:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892660.017906:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.017907:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055489536:0@lo:104: 00010000:00010000:3.0:1789892660.017920:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af349 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892660.017920:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892660.017927:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892660.017956:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892660.017959:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892660.017962:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892660.017962:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789892660.017965:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.017973:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055490176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892660.017975:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892660.017976:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055490432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.017991:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892660.017998:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055488896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.018005:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.018013:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af33b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.018020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892660.018024:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892660.018029:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892660.018033:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892660.018035:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892660.018045:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892660.018050:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892660.018092:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055489664 00000100:00100000:2.0:1789892660.018093:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055489280 00000100:00100000:1.0:1789892660.018097:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055489664 00000100:00100000:2.0:1789892660.018100:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055489280 00000100:00100000:3.0:1789892660.018102:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055489920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.018119:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 25 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.018122:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 25 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892660.018133:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892660.018146:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055490176 00000100:00100000:1.0:1789892660.018151:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055490176 00000100:00100000:2.0:1789892660.018157:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055488896 00000100:00100000:2.0:1789892660.018164:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055488896 00010000:00010000:1.0:1789892660.018165:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 26 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892660.018173:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055490560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892660.018182:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055489920 00010000:00010000:2.0:1789892660.018185:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 27 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.018187:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1789892660.018188:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055489920 00000100:00100000:1.0:1789892660.018198:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3619:x1876835055489664:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892660.018207:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892660.018211:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00010000:00010000:1.0:1789892660.018215:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892660.018217:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 28 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.018223:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3619:x1876835055489280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.018224:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 28 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.018243:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892660.018248:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 28 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.018252:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055490560 00010000:00010000:2.0:1789892660.018254:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 28 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.018259:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055490560 00000100:00100000:3.0:1789892660.018278:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:0.0:1789892660.018280:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 29 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892660.018305:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055489408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892660.018305:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 29 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.018315:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00010000:00010000:1.0:1789892660.018324:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af37a expref: 29 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.018325:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309311dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3619:x1876835055490176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892660.018330:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af3ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af3a4 expref: 29 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892660.018339:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892660.018342:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892660.018349:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892660.018350:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 28 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.018354:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892660.018359:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055490304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892660.018360:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 27 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.018376:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382800/0xd5b980e0d62af365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af35e expref: 27 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.018387:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892660.018399:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892660.018399:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055489664:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892660.018407:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055489280:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892660.018416:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1789892660.018426:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1789892660.018427:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309311dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055490176:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892660.018453:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1789892660.018454:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055489408 00000100:00100000:1.0:1789892660.018456:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055490304 00000100:00100000:3.0:1789892660.018461:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055489408 00000100:00100000:1.0:1789892660.018463:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055490304 00000100:00100000:2.0:1789892660.018473:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1789892660.018486:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00010000:00010000:3.0:1789892660.018487:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 25 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.018487:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055488896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.018491:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 25 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.018500:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055489920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892660.018517:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892660.018528:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 25 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.018532:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892660.018540:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 25 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.018546:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00010000:00010000:2.0:1789892660.018547:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 25 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.018563:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055490560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.018579:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892660.018581:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af39d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af396 expref: 25 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.018582:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 25 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.018587:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 25 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892660.018597:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1789892660.018611:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055490304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892660.018613:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af36c expref: 24 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.018615:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 24 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.018628:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892660.018638:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892660.018640:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 23 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.018644:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892660.018646:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af33b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af334 expref: 23 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.018659:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 22 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.018669:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892660.018696:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af350 expref: 22 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.018704:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3620:x1876835055488896:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (654us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892660.018711:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892660.018712:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1789892660.018719:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3620:x1876835055489920:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892660.018726:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1789892660.018736:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1789892660.018747:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055489408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892660.018751:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055490560:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892660.018759:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055490304:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (362us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892660.018759:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892660.018761:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00010000:00010000:2.0:1789892660.018767:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 19 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892660.018777:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00010000:00010000:2.0:1789892660.018782:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 18 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.018783:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055489280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892660.018800:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055490176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892660.018804:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af38f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af388 expref: 17 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.018814:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055489664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892660.018832:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892660.018834:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055490304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892660.018837:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892660.018854:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055490560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892660.018867:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055488896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892660.018871:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3620:x1876835055489408:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892660.018877:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789892660.018880:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055489920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892660.018897:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055490432 00000100:00100000:1.0:1789892660.018903:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055490432 00000100:00100000:3.0:1789892660.018907:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055489408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.018923:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 16 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.018951:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1789892660.018959:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3618:x1876835055490432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892660.018966:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892660.018970:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 16 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.018976:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 16 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.018984:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af342 expref: 16 pid: 190664 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892660.018990:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892660.019016:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3618:x1876835055490432:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892660.019021:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1789892660.019044:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055490432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892660.019136:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055489792:192.168.203.53@tcp:104: 00000100:00100000:0.0:1789892660.019141:0:216203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216203:1876835055490048:192.168.203.53@tcp:104: 00010000:00010000:0.0:1789892660.019164:0:216203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892660.019454:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892660.019504:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062736512 00000100:00100000:0.0:1789892660.019508:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062736512 00000100:00100000:1.0:1789892660.019513:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:0.0:1789892660.019526:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 10 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.019551:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062736384 00000100:00100000:0.0:1789892660.019558:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062736384 00000100:00100000:2.0:1789892660.019559:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 486 00010000:00010000:0.0:1789892660.019571:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 11 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892660.019575:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062736512:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892660.019587:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892660.019594:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 11 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.019597:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 487 00000100:00100000:0.0:1789892660.019608:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062736384:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892660.019613:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 11 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.019617:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892660.019625:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 11 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.019635:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26039f expref: 11 pid: 194990 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.019636:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 11 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.019660:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383800/0xd5b980e0d62af32d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603a6 expref: 10 pid: 190663 timeout: 3450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.019663:0:191420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.019672:0:191420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892660.019807:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892660.019811:0:191420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.019821:0:191420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.019829:0:191420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.019835:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2396:x1876835062736384:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 229us (326us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892660.019850:0:191420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892660.019851:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 487 00010000:00010000:2.0:1789892660.019860:0:191420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98000 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:2.0:1789892660.019864:0:191420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.019869:0:191420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.019887:0:191420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892660.019897:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892660.019930:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2397:x1876835062736512:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 361us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892660.019940:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 486 00010000:00010000:3.0:1789892660.019989:0:216203:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.019999:0:216203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.020007:0:216203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af3b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892660.305875:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892661.052006:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892661.052106:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062736640 00000100:00100000:0.0:1789892661.052118:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062736640 00000100:00100000:0.0:1789892661.052183:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2043 00000100:00100000:0.0:1789892661.052198:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062736640:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.052220:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892661.052260:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603ad expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.052294:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.052324:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.052336:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98800, rc 0) 00000100:00100000:0.0:1789892661.052400:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062736640:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 205us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.052411:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2043 00000100:00100000:0.0:1789892661.053589:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892661.053651:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062736768 00000100:00100000:1.0:1789892661.053657:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062736768 00000100:00100000:0.0:1789892661.053730:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2044 00000100:00100000:0.0:1789892661.053744:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062736768:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.053933:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062736768:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 191us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.053961:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2044 00000100:00100000:1.0:1789892661.054966:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892661.055027:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062736896 00000100:00100000:0.0:1789892661.055035:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062736896 00000100:00100000:0.0:1789892661.055099:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2045 00000100:00100000:0.0:1789892661.055115:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062736896:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.055231:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062736896:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 119us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.055242:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2045 00000100:00100000:1.0:1789892661.056749:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892661.056816:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062737024 00000100:00100000:2.0:1789892661.056822:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062737024 00000100:00100000:2.0:1789892661.056858:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2046 00000100:00100000:2.0:1789892661.056871:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215342:x1876835062737024:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892661.056984:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215342:x1876835062737024:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 118us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.056991:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2046 00000100:00100000:2.0:1789892661.058018:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892661.058096:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062737152 00000100:00100000:1.0:1789892661.058127:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062737152 00000100:00100000:1.0:1789892661.058170:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2047 00000100:00100000:1.0:1789892661.058181:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215342:x1876835062737152:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892661.058292:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215342:x1876835062737152:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.058306:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2047 00000100:00100000:1.0:1789892661.059714:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892661.059778:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062737280 00000100:00100000:0.0:1789892661.059786:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062737280 00000100:00100000:0.0:1789892661.059825:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2048 00000100:00100000:0.0:1789892661.059835:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062737280:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.059854:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892661.059867:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603b4 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.059890:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.059903:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.059912:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99e00, rc 0) 00000100:00100000:0.0:1789892661.059954:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062737280:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 120us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.059964:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2048 00000100:00100000:2.0:1789892661.061048:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892661.061144:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062737408 00000100:00100000:0.0:1789892661.061151:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062737408 00000100:00100000:0.0:1789892661.061188:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2049 00000100:00100000:0.0:1789892661.061198:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062737408:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.061268:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062737408:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 69us (220us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892661.061280:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2049 00000100:00100000:3.0:1789892661.266042:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055490688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892661.266173:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.266246:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055490688 00000100:00100000:2.0:1789892661.266276:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055490688 00000100:00100000:2.0:1789892661.266340:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789892661.266355:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055490688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789892661.266394:0:190693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789892661.266504:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055490688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.266514:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789892661.266588:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055490688:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789892661.329944:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892661.777859:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055491200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892661.777872:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055490816:0@lo:13:osp-pre-1-1.0 10000000:01000000:2.0:1789892661.777894:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892661.777900:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 159 10000000:01000000:2.0:1789892661.777903:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:1.0:1789892661.777933:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892661.777934:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.777945:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.777956:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.777959:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055491328:0@lo:400:kworker.0 00000100:00100000:3.0:1789892661.777967:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055491456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892661.777978:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055492352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892661.777986:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055491712:0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.778002:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.778022:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.778031:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892661.778037:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.778045:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876835055491840:0@lo:400:kworker.0 00000100:00100000:3.0:1789892661.778070:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055491968:0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.778099:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d98d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.778103:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055492224:0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.778110:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.778118:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.778125:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055492352 00000100:00100000:2.0:1789892661.778133:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055492352 00000100:00100000:0.0:1789892661.778141:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876835055492480:0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.778144:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.778149:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055492608:0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.778173:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876835055492864:0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.778186:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.778195:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:3.0:1789892661.778198:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055490816 00000100:00100000:3.0:1789892661.778203:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055490816 00000100:00100000:2.0:1789892661.778207:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055492352:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892661.778212:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055491456 00000100:00100000:1.0:1789892661.778218:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055491456 00010000:00010000:2.0:1789892661.778219:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789892661.778228:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876835055492992:0@lo:400:kworker.0 00010000:00010000:2.0:1789892661.778232:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af3c7 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892661.778259:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789892661.778259:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892661.778266:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892661.778270:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789892661.778275:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055490816:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892661.778285:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055491456:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789892661.778289:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.778296:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055491328 00010000:00010000:2.0:1789892661.778298:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382000, rc 0) 00002000:00000024:3.0:1789892661.778301:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892661.778302:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055491328 00002000:00000024:1.0:1789892661.778303:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892661.778337:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055491968 00000100:00100000:0.0:1789892661.778341:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055491968 00000100:00100000:2.0:1789892661.778349:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055492352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.778357:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:1.0:1789892661.778361:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055491456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.778366:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789892661.778367:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055490816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.778376:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789892661.778380:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055491328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892661.778387:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789892661.778397:0:192178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055491712 00000100:00100000:2.0:1789892661.778403:0:192178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055491712 00000100:00100000:1.0:1789892661.778407:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.778421:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055492224 00000100:00100000:3.0:1789892661.778426:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055492224 00000100:00100000:0.0:1789892661.778438:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055491328:12345-0@lo:400:kworker.0 Request processed in 61us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.778444:0:192178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789892661.778449:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789892661.778456:0:192178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055491712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.778460:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055490816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892661.778469:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789892661.778474:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789892661.778481:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789892661.778484:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055492224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.778488:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055491968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.778499:0:192178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055491712:12345-0@lo:400:kworker.0 Request processed in 44us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.778500:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055491584:0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.778516:0:192178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789892661.778529:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055492224:12345-0@lo:400:kworker.0 Request processed in 49us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.778536:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789892661.778544:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.778556:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055491968:12345-0@lo:400:kworker.0 Request processed in 72us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.778562:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055491584 00000100:00100000:2.0:1789892661.778565:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055492352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.778567:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789892661.778568:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055491584 00000100:00100000:1.0:1789892661.778570:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055492096:0@lo:400:kworker.0 00010000:00010000:2.0:1789892661.778592:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892661.778603:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.778604:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789892661.778605:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055491840 00000100:00100000:0.0:1789892661.778613:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055491840 00010000:00010000:2.0:1789892661.778615:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892661.778620:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055491584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.778633:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876835055492736:0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.778648:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055492480 00000100:00100000:0.0:1789892661.778654:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055492480 00000100:00100000:3.0:1789892661.778664:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055491584:12345-0@lo:400:kworker.0 Request processed in 49us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.778672:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.778675:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789892661.778705:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055492096 00000100:00100000:3.0:1789892661.778709:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055492096 00000100:00100000:0.0:1789892661.778716:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055492992 00000100:00100000:2.0:1789892661.778721:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.778723:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055492992 00000100:00100000:1.0:1789892661.778724:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055491712:0@lo:400:kworker.0 00000100:00100000:3.0:1789892661.778733:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789892661.778743:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055492224:0@lo:400:kworker.0 00000100:00100000:3.0:1789892661.778751:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055492096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.778757:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055492864 00000100:00100000:0.0:1789892661.778762:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055492864 00000100:00100000:2.0:1789892661.778768:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892661.778772:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055491584:0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.778792:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055492736 00000100:00100000:1.0:1789892661.778800:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055492096:0@lo:400:kworker.0 00000100:00100000:3.0:1789892661.778804:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055492096:12345-0@lo:400:kworker.0 Request processed in 56us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.778805:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055492736 00000100:00100000:2.0:1789892661.778811:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d98d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.778821:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789892661.778838:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00080000:3.0:1789892661.778848:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892661.778848:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876835055491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.778853:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00080000:3.0:1789892661.778855:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892661.778862:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789892661.778865:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789892661.778869:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876835055492480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.778884:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1789892661.778892:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876835055491840:12345-0@lo:400:kworker.0 Request processed in 46us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.778900:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789892661.778903:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876835055492992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.778910:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1789892661.778915:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876835055492864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.778921:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876835055492480:12345-0@lo:400:kworker.0 Request processed in 55us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.778929:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1789892661.778935:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1789892661.778947:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876835055492736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.778953:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1876835055492992:12345-0@lo:400:kworker.0 Request processed in 59us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.778960:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1789892661.778967:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055493120 00000100:00100000:3.0:1789892661.778972:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876835055492864:12345-0@lo:400:kworker.0 Request processed in 60us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.778973:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055493120 00000100:00100000:3.0:1789892661.778981:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1789892661.778990:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876835055492736:12345-0@lo:400:kworker.0 Request processed in 45us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.778997:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1789892661.779006:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892661.779011:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:3.0:1789892661.779015:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.779018:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055492608 00000100:00100000:0.0:1789892661.779022:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055492608 00000100:00100000:1.0:1789892661.779023:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055493120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892661.779049:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055490944:0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.779068:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055491456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892661.779082:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1789892661.779092:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055491968:0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.779095:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055492608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892661.779097:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.779121:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055491072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892661.779142:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055490944 00000100:00100000:2.0:1789892661.779146:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055490944 00000100:00100000:0.0:1789892661.779149:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055492608:12345-0@lo:400:kworker.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.779156:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1789892661.779162:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892661.779170:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055493120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.779177:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:1.0:1789892661.779185:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00080000:0.0:1789892661.779185:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892661.779191:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3618:x1876835055490944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892661.779207:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055491072 00000100:00100000:0.0:1789892661.779211:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055491072 00000100:00100000:1.0:1789892661.779230:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055491200 00000100:00100000:3.0:1789892661.779231:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055492608:0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.779234:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055491200 00000100:00100000:2.0:1789892661.779240:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3618:x1876835055490944:12345-0@lo:400:kworker.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.779247:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789892661.779251:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1789892661.779260:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055491072:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789892661.779271:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055490944:0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.779277:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000004:00000024:0.0:1789892661.779282:0:190675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1789892661.779289:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055491200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789892661.779306:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892661.779325:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055491328:0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.779329:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.779335:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055491072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.779342:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789892661.779346:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876835055491840:0@lo:400:kworker.0 00000100:00100000:1.0:1789892661.779354:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055491200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.779361:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789892661.779368:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876835055492480:0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.779369:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493248:0@lo:503:ll_cfg_requeue.0 00010000:00080000:3.0:1789892661.779399:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9030837eb800 x1876835055492992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789892661.779401:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9030837e8000 x1876835055492736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789892661.779402:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055491200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892661.779420:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.779426:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055491072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892661.779435:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876835055492736:0@lo:400:kworker.0 00000100:00100000:3.0:1789892661.779442:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1876835055492992:0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.779446:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d98d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.779460:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876835055492864:0@lo:400:kworker.0 00000100:00100000:2.0:1789892661.779470:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055493248 00000100:00100000:2.0:1789892661.779475:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055493248 00000100:00100000:2.0:1789892661.779507:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:2.0:1789892661.779518:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055493248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.779590:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055493248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.779600:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:0.0:1789892661.779636:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.779891:0:216204:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216204:1876835055493376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.779919:0:216204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.779938:0:216204:0:(client.c:2702:ptlrpc_set_wait()) set ffff903198aacd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892661.779965:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055493376 00000100:00100000:0.0:1789892661.779971:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055493376 00000100:00100000:0.0:1789892661.780000:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1789892661.780007:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216204:x1876835055493376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892661.780127:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216204:x1876835055493376:12345-0@lo:502:llog_process_th.0 Request processed in 120us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.780136:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:2.0:1789892661.780158:0:216204:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216204:1876835055493376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.780196:0:216204:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216204:1876835055493504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.780222:0:216204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.780236:0:216204:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031834fe180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.780260:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055493504 00000100:00100000:1.0:1789892661.780264:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055493504 00000100:00100000:1.0:1789892661.780286:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1789892661.780293:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216204:x1876835055493504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892661.780359:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216204:x1876835055493504:12345-0@lo:502:llog_process_th.0 Request processed in 67us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.780365:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:2.0:1789892661.780380:0:216204:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216204:1876835055493504:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892661.780402:0:216204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:0.0:1789892661.780479:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:0.0:1789892661.780504:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892661.780512:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.780522:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892661.780530:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789892661.780533:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789892661.780535:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892661.780551:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.780559:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.780567:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.780588:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.780615:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.780634:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030810bf540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.780706:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055493632 00000100:00100000:3.0:1789892661.780712:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055493632 00000100:00100000:3.0:1789892661.780741:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:3.0:1789892661.780747:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055493632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892661.780754:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892661.780762:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af3d5 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.780775:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.780782:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.780787:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9ca00, rc 0) 00000100:00100000:3.0:1789892661.780815:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055493632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.780821:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:0.0:1789892661.780836:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.780850:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.780858:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.780898:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.780925:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.780953:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055493760 00000100:00100000:2.0:1789892661.780958:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055493760 00000100:00100000:0.0:1789892661.780958:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030810bf540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.780985:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1789892661.780989:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055493760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.781051:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055493760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.781070:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1789892661.781103:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.781129:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.781168:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.781189:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030810bf540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.781191:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055493888 00000100:00100000:2.0:1789892661.781195:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055493888 00000100:00100000:2.0:1789892661.781219:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1789892661.781223:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055493888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.781280:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055493888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.781286:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1789892661.781308:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055493888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892661.781857:0:216205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:0.0:1789892661.781917:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:0.0:1789892661.781935:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789892661.781941:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.781950:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892661.781965:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892661.781968:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 159 10000000:01000000:0.0:1789892661.781970:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892661.781985:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.781994:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.782002:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.782016:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.782044:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892661.782093:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055494016 00000100:00100000:0.0:1789892661.782096:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d98d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.782098:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055494016 00000100:00100000:1.0:1789892661.782125:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1789892661.782130:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055494016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892661.782136:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892661.782143:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af3e3 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.782155:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.782168:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.782173:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7200, rc 0) 00000100:00100000:1.0:1789892661.782199:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055494016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.782204:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:0.0:1789892661.782242:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.782255:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.782264:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.782302:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.782330:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.782350:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d98d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.782378:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055494144 00000100:00100000:3.0:1789892661.782383:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055494144 00000100:00100000:3.0:1789892661.782411:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:3.0:1789892661.782419:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055494144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892661.782488:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055494144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.782497:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:0.0:1789892661.782526:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.782564:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.782602:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.782623:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d98d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.782627:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055494272 00000100:00100000:2.0:1789892661.782632:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055494272 00000100:00100000:2.0:1789892661.782656:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1789892661.782661:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055494272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.782733:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055494272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.782738:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1789892661.782762:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.783015:0:216206:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216206:1876835055494400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892661.783052:0:216206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.783095:0:216206:0:(client.c:2702:ptlrpc_set_wait()) set ffff903091d98d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.783109:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055494400 00000100:00100000:2.0:1789892661.783114:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055494400 00000100:00100000:2.0:1789892661.783139:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:2.0:1789892661.783144:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216206:x1876835055494400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.783201:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216206:x1876835055494400:12345-0@lo:502:llog_process_th.0 Request processed in 56us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.783208:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1789892661.783234:0:216206:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216206:1876835055494400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892661.783274:0:216206:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216206:1876835055494528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892661.783313:0:216206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.783334:0:216206:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031a00aa480 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.783350:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055494528 00000100:00100000:1.0:1789892661.783356:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055494528 00000100:00100000:1.0:1789892661.783379:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1789892661.783385:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216206:x1876835055494528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892661.783448:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216206:x1876835055494528:12345-0@lo:502:llog_process_th.0 Request processed in 62us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.783454:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1789892661.783477:0:216206:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216206:1876835055494528:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892661.783501:0:216206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:2.0:1789892661.783549:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:2.0:1789892661.783564:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892661.783570:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.783578:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892661.783583:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892661.783585:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789892661.783587:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892661.783598:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.783611:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.783617:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892661.783627:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.783647:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.783661:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186b889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.783701:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055494656 00000100:00100000:3.0:1789892661.783707:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055494656 00000100:00100000:3.0:1789892661.783733:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:3.0:1789892661.783742:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055494656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892661.783749:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892661.783758:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af3f1 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.783774:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.783783:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.783791:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9da00, rc 0) 00000100:00100000:3.0:1789892661.783825:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055494656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.783830:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892661.783836:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00010000:00010000:2.0:1789892661.783841:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.783849:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892661.783886:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.783908:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.783926:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186b889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892661.783947:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055494784 00000100:00100000:0.0:1789892661.783953:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055494784 00000100:00100000:0.0:1789892661.783985:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1789892661.783994:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055494784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.784087:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055494784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.784096:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1789892661.784105:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.784134:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.784161:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.784174:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186b889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892661.784186:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055494912 00000100:00100000:0.0:1789892661.784191:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055494912 00000100:00100000:0.0:1789892661.784220:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1789892661.784229:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055494912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.784318:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055494912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.784325:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055494912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.784331:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000040:00080000:2.0:1789892661.784886:0:216207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:0.0:1789892661.784940:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:0.0:1789892661.784961:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789892661.784968:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.784978:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892661.784986:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892661.784988:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 159 10000000:01000000:0.0:1789892661.784991:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892661.785007:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.785015:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.785024:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.785039:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.785082:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.785110:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985b79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.785136:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055495040 00000100:00100000:1.0:1789892661.785142:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055495040 00000100:00100000:1.0:1789892661.785174:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:1.0:1789892661.785182:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055495040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892661.785192:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892661.785199:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af3ff expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.785217:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.785223:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.785238:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892661.785274:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055495040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.785282:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:0.0:1789892661.785303:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.785318:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.785335:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.785376:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.785406:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.785426:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985b79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.785447:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055495168 00000100:00100000:3.0:1789892661.785452:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055495168 00000100:00100000:3.0:1789892661.785472:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:3.0:1789892661.785478:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055495168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892661.785531:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055495168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.785536:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1789892661.785549:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.785579:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.785616:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.785636:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.785652:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055495296 00000100:00100000:2.0:1789892661.785657:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055495296 00000100:00100000:2.0:1789892661.785698:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:2.0:1789892661.785705:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055495296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.785758:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055495296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.785765:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1789892661.785782:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.785983:0:216208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216208:1876835055495424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.786013:0:216208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.786033:0:216208:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186b880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892661.786038:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055495424 00000100:00100000:0.0:1789892661.786044:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055495424 00000100:00100000:0.0:1789892661.786092:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1789892661.786100:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216208:x1876835055495424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892661.786183:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216208:x1876835055495424:12345-0@lo:502:llog_process_th.0 Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.786192:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1789892661.786195:0:216208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216208:1876835055495424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.786230:0:216208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216208:1876835055495552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.786254:0:216208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.786268:0:216208:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186b880c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.786290:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055495552 00000100:00100000:1.0:1789892661.786294:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055495552 00000100:00100000:1.0:1789892661.786316:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:1.0:1789892661.786322:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216208:x1876835055495552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892661.786385:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216208:x1876835055495552:12345-0@lo:502:llog_process_th.0 Request processed in 63us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.786392:0:216208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216208:1876835055495552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892661.786393:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000040:00080000:2.0:1789892661.786418:0:216208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:0.0:1789892661.786472:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:0.0:1789892661.786490:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892661.786497:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.786507:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892661.786522:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789892661.786524:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 185 10000000:01000000:0.0:1789892661.786527:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892661.786543:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.786552:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.786561:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.786575:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.786605:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.786624:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.786652:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055495680 00000100:00100000:3.0:1789892661.786657:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055495680 00000100:00100000:3.0:1789892661.786699:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:3.0:1789892661.786708:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055495680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892661.786721:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892661.786728:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af40d expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.786740:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.786746:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892661.786751:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c400, rc 0) 00000100:00100000:3.0:1789892661.786780:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055495680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.786785:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1789892661.786797:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.786813:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.786822:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.786860:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.786885:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.786915:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055495808 00000100:00100000:2.0:1789892661.786919:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055495808 00000100:00100000:0.0:1789892661.786920:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985b7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.786944:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:2.0:1789892661.786949:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055495808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.787005:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055495808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.787011:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:0.0:1789892661.787029:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.787079:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.787113:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.787131:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985b7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.787138:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055495936 00000100:00100000:2.0:1789892661.787142:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055495936 00000100:00100000:2.0:1789892661.787170:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:2.0:1789892661.787175:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055495936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.787229:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055495936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.787235:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:0.0:1789892661.787253:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055495936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.787423:0:216209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216209:1876835055496064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.787449:0:216209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.787462:0:216209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.787481:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055496064 00000100:00100000:1.0:1789892661.787485:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055496064 00000100:00100000:1.0:1789892661.787507:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:1.0:1789892661.787513:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216209:x1876835055496064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892661.787590:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216209:x1876835055496064:12345-0@lo:502:llog_process_th.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.787597:0:216209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216209:1876835055496064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892661.787598:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000020:01000000:2.0:1789892661.787624:0:216209:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892661.787633:0:216209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892661.787635:0:216209:0:(obd_config.c:1561:class_process_config()) marker 173 (0x1) lustre-MDT0001-m new lustre.qpool1 00000020:00000080:2.0:1789892661.787640:0:216209:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1789892661.787703:0:216209:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00000100:00100000:2.0:1789892661.787720:0:216209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216209:1876835055496192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.787747:0:216209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.787765:0:216209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.787789:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055496192 00000100:00100000:3.0:1789892661.787795:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055496192 00000100:00100000:3.0:1789892661.787820:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1789892661.787826:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216209:x1876835055496192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892661.787898:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216209:x1876835055496192:12345-0@lo:502:llog_process_th.0 Request processed in 70us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.787903:0:216209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216209:1876835055496192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892661.787906:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000020:01000000:2.0:1789892661.787927:0:216209:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892661.787931:0:216209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892661.787933:0:216209:0:(obd_config.c:1561:class_process_config()) marker 173 (0x2) lustre-MDT0001-m new lustre.qpool1 00000040:00080000:2.0:1789892661.787936:0:216209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 188 count 184 00000020:01000000:0.0:1789892661.787987:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 185-187 (rc=0) 10000000:01000000:0.0:1789892661.788004:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789892661.788010:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.788020:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892661.788029:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892661.788031:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 159 10000000:01000000:0.0:1789892661.788034:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892661.788048:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.788071:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.788080:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.788094:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055496320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.788119:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.788137:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.788142:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055496320 00000100:00100000:2.0:1789892661.788146:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055496320 00000100:00100000:2.0:1789892661.788168:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:2.0:1789892661.788173:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055496320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892661.788179:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892661.788191:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af41b expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.788203:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.788209:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.788214:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383400, rc 0) 00000100:00100000:2.0:1789892661.788239:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055496320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.788244:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1789892661.788272:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055496320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.788292:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.788301:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.788340:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055496448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.788366:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.788385:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.788386:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055496448 00000100:00100000:2.0:1789892661.788390:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055496448 00000100:00100000:2.0:1789892661.788412:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:2.0:1789892661.788416:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055496448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.788469:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055496448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.788476:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:0.0:1789892661.788503:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055496448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.788528:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055496576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.788563:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.788581:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.788592:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055496576 00000100:00100000:1.0:1789892661.788596:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055496576 00000100:00100000:1.0:1789892661.788618:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:1.0:1789892661.788623:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055496576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892661.788702:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055496576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.788710:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:0.0:1789892661.788717:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055496576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892661.788872:0:216210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216210:1876835055496704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.788900:0:216210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.788918:0:216210:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030810bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.788972:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055496704 00000100:00100000:3.0:1789892661.788978:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055496704 00000100:00100000:3.0:1789892661.789002:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:3.0:1789892661.789009:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216210:x1876835055496704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892661.789095:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216210:x1876835055496704:12345-0@lo:502:llog_process_th.0 Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.789110:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1789892661.789111:0:216210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216210:1876835055496704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.789151:0:216210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216210:1876835055496832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.789176:0:216210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892661.789190:0:216210:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892661.789215:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055496832 00000100:00100000:0.0:1789892661.789221:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055496832 00000100:00100000:0.0:1789892661.789249:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:0.0:1789892661.789257:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216210:x1876835055496832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892661.789330:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216210:x1876835055496832:12345-0@lo:502:llog_process_th.0 Request processed in 72us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.789338:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1789892661.789342:0:216210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216210:1876835055496832:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892661.789364:0:216210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:0.0:1789892661.789400:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:0.0:1789892661.789422:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892661.789428:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.789450:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892661.789458:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892661.789460:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 185 10000000:01000000:0.0:1789892661.789463:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892661.789477:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.789485:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.789493:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.789507:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055496960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.789532:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.789550:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.789552:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055496960 00000100:00100000:2.0:1789892661.789556:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055496960 00000100:00100000:2.0:1789892661.789578:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1789892661.789582:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055496960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892661.789587:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892661.789594:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af429 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.789604:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.789609:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892661.789614:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382600, rc 0) 00000100:00100000:2.0:1789892661.789641:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055496960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.789646:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:0.0:1789892661.789672:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055496960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.789705:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.789715:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.789751:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055497088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.789776:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.789807:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.789857:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055497088 00000100:00100000:1.0:1789892661.789862:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055497088 00000100:00100000:1.0:1789892661.789887:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:1.0:1789892661.789894:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055497088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892661.789964:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055497088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.789973:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:0.0:1789892661.789977:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055497088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.790009:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055497216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.790045:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.790073:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.790109:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055497216 00000100:00100000:3.0:1789892661.790114:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055497216 00000100:00100000:3.0:1789892661.790140:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:3.0:1789892661.790145:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055497216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892661.790210:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055497216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892661.790216:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1789892661.790239:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055497216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892661.790443:0:216211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216211:1876835055497344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892661.790473:0:216211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.790487:0:216211:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185800240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892661.790497:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055497344 00000100:00100000:0.0:1789892661.790503:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055497344 00000100:00100000:0.0:1789892661.790532:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1789892661.790542:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216211:x1876835055497344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892661.790630:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216211:x1876835055497344:12345-0@lo:502:llog_process_th.0 Request processed in 90us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892661.790639:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:3.0:1789892661.790657:0:216211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216211:1876835055497344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892661.790696:0:216211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892661.790703:0:216211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892661.790704:0:216211:0:(obd_config.c:1561:class_process_config()) marker 172 (0x1) lustre-MDT0000-m new lustre.qpool1 00000020:00000080:3.0:1789892661.790708:0:216211:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1789892661.790736:0:216211:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00080000:10000000:3.0:1789892661.791187:0:216211:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00080000:10000000:3.0:1789892661.792616:0:216211:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x55:0x0] (8/32) registered 00080000:10000000:3.0:1789892661.793522:0:216211:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x56:0x0] (8/32) registered 00000100:00100000:3.0:1789892661.794282:0:216211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216211:1876835055497472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892661.794312:0:216211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892661.794333:0:216211:0:(client.c:2702:ptlrpc_set_wait()) set ffff903198d56180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892661.794345:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055497472 00000100:00100000:2.0:1789892661.794351:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055497472 00000100:00100000:2.0:1789892661.794377:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1789892661.794385:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216211:x1876835055497472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892661.794450:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216211:x1876835055497472:12345-0@lo:502:llog_process_th.0 Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892661.794456:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:3.0:1789892661.794474:0:216211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216211:1876835055497472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892661.794494:0:216211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892661.794502:0:216211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892661.794503:0:216211:0:(obd_config.c:1561:class_process_config()) marker 172 (0x2) lustre-MDT0000-m new lustre.qpool1 00000040:00080000:3.0:1789892661.794506:0:216211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 188 count 184 00000020:01000000:0.0:1789892661.794561:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 185-187 (rc=0) 10000000:01000000:0.0:1789892661.794579:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789892661.794586:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.794596:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892661.794604:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789892661.794607:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:0.0:1789892661.794609:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789892661.794624:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.794632:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.794648:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.794662:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055497600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.794717:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.794748:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892661.794758:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055497600 00000100:00100000:1.0:1789892661.794763:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055497600 00000100:00100000:1.0:1789892661.794789:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1789892661.794795:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055497600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892661.794802:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892661.794809:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af437 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.794821:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.794828:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892661.794833:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7000, rc 0) 00000100:00100000:1.0:1789892661.794882:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055497600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892661.794892:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:0.0:1789892661.794912:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055497600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892661.794930:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.794942:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892661.794985:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055497728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892661.795015:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892661.795035:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632000 going to sleep for 11 seconds 00000100:00100000:3.0:1789892661.795112:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055497728 00000100:00100000:3.0:1789892661.795117:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055497728 00000100:00100000:3.0:1789892661.795143:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:3.0:1789892661.795149:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055497728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892661.795199:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055497728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (185us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892661.795205:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:0.0:1789892661.795234:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055497728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789892661.795256:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789892661.795261:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892661.795270:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.354778:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789892662.695848:0:216308:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff48dcf8f0 20000000:00000080:3.0:1789892662.695866:0:216308:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90309182a800 uarg=0000000000000000 00000040:00100000:3.0:1789892662.696606:0:216308:0:(llog.c:1072:llog_reverse_process()) index 161 : idx 137 20000000:01000000:3.0:1789892662.696614:0:216308:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 160 cmd:0xce020 lustre.qpool1 00000040:00080000:3.0:1789892662.696742:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].162, 224 off37728 20000000:01000000:3.0:1789892662.696772:0:216308:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:3.0:1789892662.696791:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].163, 128 off37856 00000040:00080000:3.0:1789892662.696808:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].164, 224 off38080 00000040:00080000:3.0:1789892662.696868:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].188, 224 off42504 20000000:01000000:3.0:1789892662.696878:0:216308:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:3.0:1789892662.696895:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].189, 136 off42640 00000040:00080000:3.0:1789892662.696910:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].190, 224 off42864 00000040:00080000:3.0:1789892662.696967:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].188, 224 off42504 20000000:01000000:3.0:1789892662.696976:0:216308:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:3.0:1789892662.696990:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].189, 136 off42640 00000040:00080000:3.0:1789892662.697004:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].190, 224 off42864 10000000:01000000:3.0:1789892662.697015:0:216308:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789892662.697037:0:216308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697092:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697101:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697109:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697116:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697123:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697130:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697136:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697143:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697149:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697156:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697173:0:216308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697180:0:216308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697220:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697234:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 23 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.697250:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055497856:0@lo:104: 00000100:00100000:3.0:1789892662.697313:0:216308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892662.697370:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697379:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 23 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.697387:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055497984:0@lo:104: 00000100:00100000:3.0:1789892662.697419:0:216308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892662.697435:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055497856 00000100:00100000:1.0:1789892662.697446:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055497856 00010000:00010000:3.0:1789892662.697450:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.697463:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 23 pid: 190663 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.697476:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498112:0@lo:104: 00000100:00100000:0.0:1789892662.697491:0:191419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789892662.697513:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055497984 00000100:00100000:1.0:1789892662.697519:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055497984 00010000:00010000:3.0:1789892662.697528:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.697546:0:191419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892662.697554:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 23 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.697566:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498240:0@lo:104: 00000100:00100000:1.0:1789892662.697584:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055498112 00000100:00100000:1.0:1789892662.697590:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055498112 00000100:00100000:2.0:1789892662.697598:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789892662.697606:0:216308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892662.697626:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00010000:00010000:3.0:1789892662.697636:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.697640:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216308:x1876835055497856:12345-0@lo:104: 00000100:00100000:1.0:1789892662.697642:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055498240 00000100:00100000:0.0:1789892662.697649:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a1d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216308:x1876835055497984:12345-0@lo:104: 00000100:00100000:1.0:1789892662.697651:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055498240 00010000:00010000:3.0:1789892662.697660:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 23 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892662.697675:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.697717:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498368:0@lo:104: 00010000:00010000:0.0:1789892662.697734:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.697762:0:216308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892662.697800:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055498368 00000100:00100000:1.0:1789892662.697806:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055498368 00000100:00100000:1.0:1789892662.697843:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00010000:00010000:3.0:1789892662.697844:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892662.697848:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789892662.697858:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892662.697861:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+7:216308:x1876835055498112:12345-0@lo:104: 00010000:00010000:3.0:1789892662.697871:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 23 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.697875:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+7:216308:x1876835055497856:12345-0@lo:104: Request processed in 241us (551us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892662.697882:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.697893:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498496:0@lo:104: 00000100:00100000:0.0:1789892662.697894:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a1d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+7:216308:x1876835055497984:12345-0@lo:104: Request processed in 235us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892662.697911:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1789892662.697927:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789892662.697950:0:216308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892662.697960:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055498496 00000100:00100000:2.0:1789892662.697970:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055498496 00010000:00010000:3.0:1789892662.698002:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698011:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892662.698013:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00010000:00010000:3.0:1789892662.698020:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 23 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.698029:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:216308:x1876835055498112:12345-0@lo:104: Request processed in 171us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892662.698036:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:216308:x1876835055498240:12345-0@lo:104: 00000100:00100000:2.0:1789892662.698039:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00010000:00010000:0.0:1789892662.698078:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.698085:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1789892662.698094:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:216308:x1876835055498368:12345-0@lo:104: 00000100:00100000:3.0:1789892662.698096:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498624:0@lo:104: 00000100:00100000:1.0:1789892662.698116:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00010000:00010000:2.0:1789892662.698123:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.698132:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216308:x1876835055498496:12345-0@lo:104: 00010000:00010000:1.0:1789892662.698153:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.698168:0:216308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892662.698182:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789892662.698193:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216308:x1876835055498240:12345-0@lo:104: Request processed in 165us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892662.698203:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00010000:00010000:3.0:1789892662.698218:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.698231:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055498624 00010000:00010000:2.0:1789892662.698239:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:3.0:1789892662.698240:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 23 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698241:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789892662.698241:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055498624 00000100:00100000:1.0:1789892662.698265:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216308:x1876835055498496:12345-0@lo:104: Request processed in 131us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892662.698267:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216308:x1876835055498368:12345-0@lo:104: Request processed in 174us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892662.698270:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498752:0@lo:104: 00000100:00100000:0.0:1789892662.698280:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789892662.698295:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789892662.698297:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216308:x1876835055498624:12345-0@lo:104: 00010000:00010000:0.0:1789892662.698310:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.698319:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00010000:00010000:1.0:1789892662.698330:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:3.0:1789892662.698341:0:216308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892662.698342:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698354:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99000 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:2.0:1789892662.698361:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055498752 10000000:00010000:1.0:1789892662.698371:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.698374:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055498752 00010000:00010000:0.0:1789892662.698377:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789892662.698395:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216308:x1876835055498624:12345-0@lo:104: Request processed in 96us (230us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892662.698396:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.698407:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892662.698410:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.698425:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 10000000:01000000:1.0:1789892662.698446:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892662.698447:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789892662.698449:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216308:x1876835055498752:12345-0@lo:104: 00010000:00010000:3.0:1789892662.698456:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 23 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892662.698480:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.698481:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498880:0@lo:104: 00010000:00010000:1.0:1789892662.698492:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698501:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789892662.698516:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698517:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892662.698534:0:216308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892662.698535:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99a00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892662.698542:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698553:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698555:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892662.698574:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698576:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99000/0xd5b980e0d62af437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af43e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892662.698583:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:3.0:1789892662.698588:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892662.698598:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892662.698607:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216308:x1876835055498752:12345-0@lo:104: Request processed in 158us (267us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892662.698624:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 9 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698626:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789892662.698637:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698641:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.698646:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1789892662.698649:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055499136:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892662.698673:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892662.698673:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789892662.698721:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698731:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698732:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.698739:0:194861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789892662.698765:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af430 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892662.698796:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698799:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 10000000:01000000:1.0:1789892662.698809:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892662.698810:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698835:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99800 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892662.698840:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698842:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698864:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892662.698864:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892662.698877:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698879:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892662.698894:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892662.698902:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af41b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af422 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698925:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892662.698930:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698931:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698946:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98a00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892662.698949:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789892662.698953:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698962:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.698965:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.698992:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af40d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af414 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892662.698993:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.699020:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055498880 10000000:01000000:1.0:1789892662.699020:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892662.699026:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789892662.699031:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055498880 00010000:00010000:0.0:1789892662.699034:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.699045:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382c00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892662.699069:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699078:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699089:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892662.699119:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.699121:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.699131:0:216308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.699137:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00010000:00010000:1.0:1789892662.699149:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98a00/0xd5b980e0d62af3ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af406 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892662.699159:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.699162:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216308:x1876835055498880:12345-0@lo:104: 00010000:00010000:1.0:1789892662.699184:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892662.699192:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892662.699195:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892662.699196:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.699207:0:216308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 9 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.699225:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699233:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99400 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892662.699243:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.699250:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892662.699253:0:216308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055499776:192.168.203.53@tcp:104: 00010000:00010000:0.0:1789892662.699263:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699272:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.699276:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af3f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3f8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892662.699280:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:1.0:1789892662.699291:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.699302:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216308:x1876835055498880:12345-0@lo:104: Request processed in 142us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892662.699304:0:216308:0:(client.c:2702:ptlrpc_set_wait()) set ffff903198d56cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1789892662.699306:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:1.0:1789892662.699307:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892662.699318:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.699329:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00010000:00010000:0.0:1789892662.699330:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98e00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892662.699342:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055497856:0@lo:104: 10000000:00010000:0.0:1789892662.699343:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699344:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.699369:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055497984:0@lo:104: 00010000:00010000:0.0:1789892662.699377:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699380:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789892662.699391:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.699392:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498112:0@lo:104: 00010000:00010000:2.0:1789892662.699398:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892662.699398:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.699405:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498240:0@lo:104: 00010000:00010000:2.0:1789892662.699414:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.699426:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498368:0@lo:104: 10000000:01000000:0.0:1789892662.699432:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892662.699448:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498496:0@lo:104: 00010000:00010000:2.0:1789892662.699451:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892662.699463:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699471:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99400/0xd5b980e0d62af3e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ea expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.699473:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.699474:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498624:0@lo:104: 00010000:00010000:2.0:1789892662.699497:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.699498:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498752:0@lo:104: 00010000:00010000:0.0:1789892662.699513:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892662.699525:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055498880:0@lo:104: 00010000:00010000:1.0:1789892662.699526:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789892662.699529:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.699530:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699533:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892662.699540:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892662.699558:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af3d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3dc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.699559:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789892662.699561:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892662.699577:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892662.699582:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892662.699589:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892662.699594:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892662.699611:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.699615:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055499264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892662.699624:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055499008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892662.699642:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892662.699660:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892662.699674:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af3c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af3ce expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.699683:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892662.699751:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892662.699780:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892662.699788:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892662.699792:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055499904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892662.699797:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892662.699801:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055499648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892662.699839:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892662.699843:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055499520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892662.699865:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055499264 00000100:00100000:1.0:1789892662.699871:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055499264 00000100:00100000:3.0:1789892662.699890:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055499392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892662.699903:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 24 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.699910:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055499008 00000100:00100000:2.0:1789892662.699916:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892662.699920:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055499008 00010000:00010000:0.0:1789892662.699947:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 25 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.699966:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055499904 00000100:00100000:1.0:1789892662.699972:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055499904 00000100:00100000:3.0:1789892662.699984:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055499520 00000100:00100000:2.0:1789892662.699990:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055500160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892662.699992:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1789892662.699995:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055499520 00010000:00010000:1.0:1789892662.699996:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 26 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.700012:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3618:x1876835055499264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892662.700027:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892662.700031:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 27 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.700033:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00010000:00010000:0.0:1789892662.700040:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 27 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.700077:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3621:x1876835055499008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892662.700083:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1789892662.700086:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892662.700088:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 27 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.700103:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892662.700105:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3618:x1876835055499904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892662.700114:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 27 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.700116:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382600/0xd5b980e0d62af430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af429 expref: 27 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.700120:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892662.700126:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789892662.700144:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 27 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.700149:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055500288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892662.700150:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892662.700171:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 26 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.700188:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 26 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.700206:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3618:x1876835055499264:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (527us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892662.700210:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af43e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af437 expref: 26 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892662.700219:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af3f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af3f1 expref: 26 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.700225:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892662.700232:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00010000:00010000:1.0:1789892662.700256:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892662.700259:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892662.700270:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055500160 00000100:00100000:0.0:1789892662.700277:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055500160 00000100:00100000:2.0:1789892662.700287:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055500288 00000100:00100000:2.0:1789892662.700297:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055500288 00010000:00010000:0.0:1789892662.700298:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 24 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.700307:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3621:x1876835055499008:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892662.700322:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1789892662.700331:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00010000:00010000:2.0:1789892662.700334:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 25 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.700349:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055499520:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892662.700352:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00010000:00010000:0.0:1789892662.700370:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892662.700372:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055500160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892662.700380:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 24 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.700390:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892662.700391:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00010000:00010000:0.0:1789892662.700400:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 24 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.700404:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 24 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.700417:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055500288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892662.700428:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af40d expref: 24 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.700431:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055499904:12345-0@lo:103:ldlm_bl.0 Request processed in 328us (589us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892662.700436:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 24 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892662.700444:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892662.700463:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 24 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.700464:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00010000:00010000:0.0:1789892662.700476:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892662.700488:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62af3dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af3d5 expref: 22 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892662.700500:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 22 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892662.700518:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892662.700523:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892662.700537:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382000/0xd5b980e0d62af3ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af3c7 expref: 21 pid: 190664 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.700539:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3620:x1876835055499520:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892662.700555:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055500032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892662.700561:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892662.700563:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1789892662.700592:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055499392 00000100:00100000:1.0:1789892662.700594:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055500160:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892662.700600:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055499392 00000100:00100000:1.0:1789892662.700608:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1789892662.700616:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892662.700626:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 20 pid: 190663 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.700640:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055500288:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892662.700644:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055500032 00000100:00100000:1.0:1789892662.700653:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055500032 00000100:00100000:0.0:1789892662.700658:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1789892662.700670:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789892662.700706:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3619:x1876835055499392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892662.700718:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892662.700724:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 20 pid: 190663 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.700740:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 20 pid: 190663 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.700756:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af41b expref: 19 pid: 190663 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.700771:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892662.700825:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055499264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892662.700827:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3619:x1876835055499392:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (315us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892662.700838:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 18 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.700851:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1789892662.700860:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055499904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892662.700886:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1789892662.700901:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3619:x1876835055500032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892662.700911:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892662.700917:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 17 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.700933:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892662.700949:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 17 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.700959:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055499392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892662.700969:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af3ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af3e3 expref: 17 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.700988:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892662.701031:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055499008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892662.701071:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055500032:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892662.701082:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1789892662.701094:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055499648 00000100:00100000:1.0:1789892662.701101:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055499648 00010000:00010000:1.0:1789892662.701125:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 16 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.701163:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1789892662.701174:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3621:x1876835055499648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892662.701180:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055500032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892662.701185:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892662.701195:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 16 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701208:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 16 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.701214:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055499136:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892662.701235:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af3ff expref: 16 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.701241:0:216308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216308:1876835055499776:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892662.701257:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892662.701314:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3621:x1876835055499648:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892662.701323:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00010000:00010000:0.0:1789892662.701352:0:216308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892662.701395:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892662.701405:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055499648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892662.701427:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055500288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892662.701444:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055499520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892662.701464:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062737536 00000100:00100000:2.0:1789892662.701473:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892662.701475:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062737536 00010000:00010000:0.0:1789892662.701506:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 10 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.701529:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062737664 00000100:00100000:3.0:1789892662.701531:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055500160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892662.701536:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062737664 00000100:00100000:0.0:1789892662.701562:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 497 00010000:00010000:1.0:1789892662.701573:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 11 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.701579:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062737536:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892662.701597:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892662.701603:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 11 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.701634:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 11 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.701648:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 498 00010000:00010000:0.0:1789892662.701674:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af3c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603b4 expref: 11 pid: 190662 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.701675:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062737664:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892662.701751:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892662.701764:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 10 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.701770:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892662.701784:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 10 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701800:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af3b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ad expref: 10 pid: 194990 timeout: 3452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701815:0:193695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.701824:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2397:x1876835062737536:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 248us (432us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892662.701830:0:193695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892662.701840:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 497 00010000:00010000:1.0:1789892662.701853:0:193695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701863:0:193695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701871:0:193695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701877:0:193695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701891:0:193695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9de00 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:1.0:1789892662.701896:0:193695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701904:0:193695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701924:0:193695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892662.701934:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892662.701954:0:216308:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.701965:0:216308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.701997:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2396:x1876835062737664:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 311us (508us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892662.701998:0:216308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9de00/0xd5b980e0d62af445 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892662.702023:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 498 00000020:00000080:0.0:1789892662.702137:0:216308:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff48dcf8f0 20000000:00000080:0.0:1789892662.702148:0:216308:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9030837ed000 uarg=0000000000000000 00000040:00100000:0.0:1789892662.702890:0:216308:0:(llog.c:1072:llog_reverse_process()) index 164 : idx 137 20000000:01000000:0.0:1789892662.702897:0:216308:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 160 cmd:0xce020 lustre.qpool1 00000040:00080000:0.0:1789892662.702952:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].165, 224 off38304 20000000:01000000:0.0:1789892662.702966:0:216308:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892662.703001:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].166, 128 off38432 00000040:00080000:0.0:1789892662.703019:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].167, 224 off38656 00000040:00080000:0.0:1789892662.703124:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].191, 224 off43088 20000000:01000000:0.0:1789892662.703135:0:216308:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892662.703149:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].192, 136 off43224 00000040:00080000:0.0:1789892662.703164:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].193, 224 off43448 00000040:00080000:0.0:1789892662.703211:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].191, 224 off43088 20000000:01000000:0.0:1789892662.703232:0:216308:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892662.703247:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].192, 136 off43224 00000040:00080000:0.0:1789892662.703262:0:216308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].193, 224 off43448 10000000:01000000:0.0:1789892662.703272:0:216308:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789892662.703285:0:216308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703296:0:216308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703304:0:216308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703310:0:216308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703317:0:216308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703324:0:216308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703330:0:216308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99200 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:0.0:1789892662.703333:0:216308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703340:0:216308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703349:0:216308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703355:0:216308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892662.703369:0:216308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af44c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892663.051971:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892663.052060:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062737792 00000100:00100000:0.0:1789892663.052072:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062737792 00000100:00100000:0.0:1789892663.052134:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2089 00000100:00100000:0.0:1789892663.052143:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062737792:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892663.052162:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892663.052181:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603bb expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.052210:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.052222:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.052231:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892663.052290:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062737792:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 146us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892663.052300:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2089 00000100:00100000:2.0:1789892663.053577:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892663.053640:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062737920 00000100:00100000:0.0:1789892663.053647:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062737920 00000100:00100000:3.0:1789892663.053726:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2090 00000100:00100000:3.0:1789892663.053742:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062737920:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892663.053877:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062737920:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 140us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892663.053885:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2090 00000100:00100000:3.0:1789892663.054858:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892663.054967:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062738048 00000100:00100000:1.0:1789892663.054980:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062738048 00000100:00100000:1.0:1789892663.055021:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2091 00000100:00100000:1.0:1789892663.055029:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062738048:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.055152:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062738048:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 122us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.055160:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2091 00000100:00100000:2.0:1789892663.056790:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892663.056846:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062738176 00000100:00100000:0.0:1789892663.056853:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062738176 00000100:00100000:0.0:1789892663.056897:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2092 00000100:00100000:0.0:1789892663.056919:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215386:x1876835062738176:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892663.057082:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215386:x1876835062738176:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 171us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892663.057094:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2092 00000100:00100000:2.0:1789892663.058310:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892663.058366:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062738304 00000100:00100000:0.0:1789892663.058372:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062738304 00000100:00100000:0.0:1789892663.058406:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2093 00000100:00100000:0.0:1789892663.058413:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215386:x1876835062738304:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892663.058520:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215386:x1876835062738304:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 104us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892663.058529:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2093 00000100:00100000:3.0:1789892663.059974:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892663.060070:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062738432 00000100:00100000:0.0:1789892663.060079:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062738432 00000100:00100000:0.0:1789892663.060131:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2094 00000100:00100000:0.0:1789892663.060145:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062738432:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892663.060159:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892663.060177:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603c2 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.060205:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.060217:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.060226:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99e00, rc 0) 00000100:00100000:0.0:1789892663.060266:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062738432:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 125us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892663.060284:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2094 00000100:00100000:2.0:1789892663.061399:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892663.061474:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062738560 00000100:00100000:1.0:1789892663.061483:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062738560 00000100:00100000:1.0:1789892663.061531:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2095 00000100:00100000:1.0:1789892663.061541:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062738560:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.061623:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062738560:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 83us (227us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892663.061644:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2095 00000100:00100000:0.0:1789892663.313953:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055500416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892663.314042:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892663.314113:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055500416 00000100:00100000:2.0:1789892663.314123:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055500416 00000100:00080000:0.0:1789892663.314170:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789892663.314189:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789892663.314201:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055500416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789892663.314237:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789892663.314287:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055500416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.314296:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789892663.314340:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055500416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789892663.377858:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892663.505792:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892663.505799:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 162 10000000:01000000:1.0:1789892663.505803:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892663.505843:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.505853:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.505862:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.505882:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055500544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.505940:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.505974:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.506014:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055500544 00000100:00100000:2.0:1789892663.506023:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055500544 00000100:00100000:2.0:1789892663.506094:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:2.0:1789892663.506105:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055500544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892663.506120:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892663.506135:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af461 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.506160:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.506172:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.506182:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383e00, rc 0) 00000100:00100000:2.0:1789892663.506242:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055500544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.506251:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:1.0:1789892663.506268:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055500544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892663.506281:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.506289:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.506333:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055500672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.506352:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.506366:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892663.506401:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055500672 00000100:00100000:0.0:1789892663.506408:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055500672 00000100:00100000:0.0:1789892663.506445:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1789892663.506456:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055500672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.506585:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055500672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892663.506594:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:1.0:1789892663.506597:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055500672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.506625:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055500800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.506657:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.506671:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892663.506705:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055500800 00000100:00100000:0.0:1789892663.506711:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055500800 00000100:00100000:0.0:1789892663.506742:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:0.0:1789892663.506750:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055500800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.506844:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055500800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892663.506854:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1789892663.506860:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055500800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.507134:0:216309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216309:1876835055500928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.507160:0:216309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.507178:0:216309:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.507207:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055500928 00000100:00100000:2.0:1789892663.507213:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055500928 00000100:00100000:2.0:1789892663.507246:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:2.0:1789892663.507254:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216309:x1876835055500928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.507363:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216309:x1876835055500928:12345-0@lo:502:llog_process_th.0 Request processed in 109us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.507377:0:216309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216309:1876835055500928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.507381:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1789892663.507416:0:216309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216309:1876835055501056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.507442:0:216309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.507454:0:216309:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.507475:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055501056 00000100:00100000:2.0:1789892663.507480:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055501056 00000100:00100000:2.0:1789892663.507512:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:2.0:1789892663.507520:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216309:x1876835055501056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.507598:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216309:x1876835055501056:12345-0@lo:502:llog_process_th.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.507606:0:216309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216309:1876835055501056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.507609:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000040:00080000:1.0:1789892663.507627:0:216309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:0.0:1789892663.507719:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:0.0:1789892663.507747:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892663.507755:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.507766:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892663.507783:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789892663.507785:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789892663.507788:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892663.507804:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.507813:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.507821:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892663.507836:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.507861:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.507887:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.507900:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055501184 00000100:00100000:2.0:1789892663.507905:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055501184 00000100:00100000:2.0:1789892663.507928:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1789892663.507932:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055501184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892663.507939:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892663.507945:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af46f expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.507956:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.507962:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.507966:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383a00, rc 0) 00000100:00100000:2.0:1789892663.507991:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055501184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 58us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.507995:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:0.0:1789892663.508033:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892663.508063:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.508072:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892663.508119:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.508149:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.508177:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.508209:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055501312 00000100:00100000:3.0:1789892663.508214:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055501312 00000100:00100000:3.0:1789892663.508238:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:3.0:1789892663.508243:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055501312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892663.508307:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055501312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892663.508312:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:0.0:1789892663.508347:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.508386:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.508427:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.508450:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892663.508460:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055501440 00000100:00100000:1.0:1789892663.508464:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055501440 00000100:00100000:1.0:1789892663.508487:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1789892663.508492:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055501440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.508547:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055501440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.508554:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:0.0:1789892663.508580:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892663.509384:0:216310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:1.0:1789892663.509436:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:1.0:1789892663.509457:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892663.509462:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.509473:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892663.509479:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892663.509480:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 162 10000000:01000000:1.0:1789892663.509482:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892663.509492:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.509498:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.509503:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.509512:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.509531:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.509549:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.509578:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055501568 00000100:00100000:2.0:1789892663.509590:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055501568 00000100:00100000:2.0:1789892663.509618:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:2.0:1789892663.509627:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055501568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892663.509635:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892663.509645:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af47d expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.509658:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.509666:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.509673:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382a00, rc 0) 00000100:00100000:2.0:1789892663.509729:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055501568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.509738:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1789892663.509744:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892663.509755:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.509761:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.509790:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.509809:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.509834:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.509848:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055501696 00000100:00100000:2.0:1789892663.509852:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055501696 00000100:00100000:2.0:1789892663.509873:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:2.0:1789892663.509878:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055501696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892663.509932:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055501696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.509938:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:1.0:1789892663.509941:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.509966:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.509992:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.510005:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.510025:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055501824 00000100:00100000:3.0:1789892663.510030:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055501824 00000100:00100000:3.0:1789892663.510067:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1789892663.510078:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055501824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892663.510152:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055501824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892663.510159:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:1.0:1789892663.510174:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055501824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.510350:0:216311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216311:1876835055501952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.510376:0:216311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.510389:0:216311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.510407:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055501952 00000100:00100000:2.0:1789892663.510410:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055501952 00000100:00100000:2.0:1789892663.510431:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:2.0:1789892663.510436:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216311:x1876835055501952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.510500:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216311:x1876835055501952:12345-0@lo:502:llog_process_th.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.510506:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1789892663.510516:0:216311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216311:1876835055501952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.510549:0:216311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216311:1876835055502080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.510573:0:216311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.510587:0:216311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.510596:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055502080 00000100:00100000:2.0:1789892663.510602:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055502080 00000100:00100000:2.0:1789892663.510633:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:2.0:1789892663.510640:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216311:x1876835055502080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.510721:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216311:x1876835055502080:12345-0@lo:502:llog_process_th.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.510727:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:1.0:1789892663.510737:0:216311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216311:1876835055502080:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892663.510758:0:216311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:0.0:1789892663.510800:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:0.0:1789892663.510821:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892663.510825:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.510832:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892663.510838:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789892663.510839:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:0.0:1789892663.510841:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892663.510853:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.510858:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.510864:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892663.510872:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.510894:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.510919:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.510928:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055502208 00000100:00100000:2.0:1789892663.510932:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055502208 00000100:00100000:2.0:1789892663.510953:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1789892663.510958:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055502208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892663.510962:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892663.510969:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af48b expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.510978:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 19 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.510984:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 19 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.510989:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383000, rc 0) 00000100:00100000:2.0:1789892663.511011:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055502208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.511024:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:0.0:1789892663.511029:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892663.511040:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.511060:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892663.511091:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.511112:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.511133:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.511159:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055502336 00000100:00100000:3.0:1789892663.511164:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055502336 00000100:00100000:3.0:1789892663.511187:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:3.0:1789892663.511194:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055502336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892663.511254:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055502336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892663.511260:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:0.0:1789892663.511280:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.511303:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.511330:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.511346:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892663.511358:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055502464 00000100:00100000:1.0:1789892663.511362:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055502464 00000100:00100000:1.0:1789892663.511384:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:1.0:1789892663.511389:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055502464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.511450:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055502464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.511456:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:0.0:1789892663.511464:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892663.512000:0:216312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:1.0:1789892663.512039:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:1.0:1789892663.512066:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892663.512075:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.512082:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892663.512087:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892663.512088:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 162 10000000:01000000:1.0:1789892663.512090:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892663.512100:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.512105:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.512110:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.512119:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.512137:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.512154:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.512171:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055502592 00000100:00100000:2.0:1789892663.512175:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055502592 00000100:00100000:2.0:1789892663.512196:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:2.0:1789892663.512200:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055502592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892663.512205:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892663.512211:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af499 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.512222:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.512228:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.512233:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382200, rc 0) 00000100:00100000:2.0:1789892663.512259:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055502592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.512263:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00100000:1.0:1789892663.512284:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892663.512295:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.512301:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.512326:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.512351:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.512364:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.512373:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055502720 00000100:00100000:2.0:1789892663.512377:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055502720 00000100:00100000:2.0:1789892663.512394:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1789892663.512399:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055502720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892663.512450:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055502720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.512456:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00100000:1.0:1789892663.512458:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.512482:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.512510:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.512523:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.512538:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055502848 00000100:00100000:3.0:1789892663.512542:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055502848 00000100:00100000:3.0:1789892663.512565:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:3.0:1789892663.512571:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055502848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892663.512640:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055502848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.512655:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055502848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892663.512656:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:0.0:1789892663.512871:0:216313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216313:1876835055502976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892663.512914:0:216313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.512950:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055502976 00000100:00100000:1.0:1789892663.512954:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055502976 00000100:00100000:0.0:1789892663.512957:0:216313:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892663.512979:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:1.0:1789892663.512985:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216313:x1876835055502976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.513059:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216313:x1876835055502976:12345-0@lo:502:llog_process_th.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.513066:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:0.0:1789892663.513083:0:216313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216313:1876835055502976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892663.513127:0:216313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216313:1876835055503104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892663.513165:0:216313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.513187:0:216313:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.513190:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055503104 00000100:00100000:2.0:1789892663.513198:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055503104 00000100:00100000:2.0:1789892663.513220:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1789892663.513224:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216313:x1876835055503104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.513278:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216313:x1876835055503104:12345-0@lo:502:llog_process_th.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.513283:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:0.0:1789892663.513303:0:216313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216313:1876835055503104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892663.513334:0:216313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:1.0:1789892663.513385:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:1.0:1789892663.513404:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892663.513408:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.513414:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892663.513419:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892663.513421:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 188 10000000:01000000:1.0:1789892663.513422:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892663.513433:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.513442:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.513448:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.513456:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055503232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.513476:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.513489:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.513498:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055503232 00000100:00100000:2.0:1789892663.513502:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055503232 00000100:00100000:2.0:1789892663.513520:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1789892663.513525:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055503232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892663.513530:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892663.513536:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af4a7 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.513545:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 21 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.513551:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 21 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.513556:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383200, rc 0) 00000100:00100000:2.0:1789892663.513580:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055503232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.513585:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:1.0:1789892663.513589:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055503232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892663.513600:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.513606:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.513632:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055503360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.513648:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.513660:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.513700:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055503360 00000100:00100000:3.0:1789892663.513705:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055503360 00000100:00100000:3.0:1789892663.513730:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:3.0:1789892663.513737:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055503360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892663.513792:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055503360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892663.513798:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1789892663.513806:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055503360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.513828:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055503488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.513854:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.513877:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.513880:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055503488 00000100:00100000:2.0:1789892663.513885:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055503488 00000100:00100000:2.0:1789892663.513906:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1789892663.513910:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055503488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892663.513967:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055503488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.513974:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:1.0:1789892663.513983:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055503488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.514145:0:216314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216314:1876835055503616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.514173:0:216314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.514186:0:216314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.514196:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055503616 00000100:00100000:2.0:1789892663.514200:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055503616 00000100:00100000:2.0:1789892663.514221:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:2.0:1789892663.514225:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216314:x1876835055503616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.514293:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216314:x1876835055503616:12345-0@lo:502:llog_process_th.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.514299:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:1.0:1789892663.514306:0:216314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216314:1876835055503616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892663.514328:0:216314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892663.514337:0:216314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892663.514339:0:216314:0:(obd_config.c:1561:class_process_config()) marker 176 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:1.0:1789892663.514343:0:216314:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1789892663.514356:0:216314:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to qpool1 as member 1 00000020:01000000:1.0:1789892663.514360:0:216314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892663.514361:0:216314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892663.514362:0:216314:0:(obd_config.c:1561:class_process_config()) marker 176 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0000_UUID 00000020:01000000:1.0:1789892663.514364:0:216314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892663.514366:0:216314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892663.514367:0:216314:0:(obd_config.c:1561:class_process_config()) marker 179 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:1.0:1789892663.514369:0:216314:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1789892663.514372:0:216314:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 2 00000100:00100000:1.0:1789892663.514383:0:216314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216314:1876835055503744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.514408:0:216314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.514421:0:216314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892663.514437:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055503744 00000100:00100000:0.0:1789892663.514442:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055503744 00000100:00100000:0.0:1789892663.514465:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1789892663.514472:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216314:x1876835055503744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892663.514534:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216314:x1876835055503744:12345-0@lo:502:llog_process_th.0 Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892663.514540:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:1.0:1789892663.514546:0:216314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216314:1876835055503744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892663.514565:0:216314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892663.514568:0:216314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892663.514569:0:216314:0:(obd_config.c:1561:class_process_config()) marker 179 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:1.0:1789892663.514572:0:216314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 194 count 190 00000020:01000000:0.0:1789892663.514605:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 188-193 (rc=0) 10000000:01000000:0.0:1789892663.514623:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789892663.514629:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.514636:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892663.514642:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892663.514644:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 162 10000000:01000000:0.0:1789892663.514645:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892663.514656:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.514662:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.514667:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892663.514696:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055503872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.514724:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.514743:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.514762:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055503872 00000100:00100000:3.0:1789892663.514768:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055503872 00000100:00100000:3.0:1789892663.514796:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:3.0:1789892663.514806:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055503872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892663.514815:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892663.514825:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af4b5 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892663.514842:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892663.514862:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892663.514876:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9da00, rc 0) 00000100:00100000:3.0:1789892663.514919:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055503872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892663.514929:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1789892663.514937:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055503872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892663.514948:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.514955:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892663.514984:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.515002:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.515016:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.515033:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055504000 00000100:00100000:2.0:1789892663.515037:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055504000 00000100:00100000:2.0:1789892663.515068:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:2.0:1789892663.515074:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055504000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892663.515124:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055504000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.515130:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:0.0:1789892663.515140:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.515169:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.515207:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.515227:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.515241:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055504128 00000100:00100000:2.0:1789892663.515244:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055504128 00000100:00100000:2.0:1789892663.515262:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:2.0:1789892663.515266:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055504128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892663.515317:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055504128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.515324:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:0.0:1789892663.515340:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.515502:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216315:1876835055504256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892663.515527:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.515541:0:216315:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.515555:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055504256 00000100:00100000:2.0:1789892663.515559:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055504256 00000100:00100000:2.0:1789892663.515585:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:2.0:1789892663.515591:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216315:x1876835055504256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892663.515669:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216315:x1876835055504256:12345-0@lo:502:llog_process_th.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.515675:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:0.0:1789892663.515697:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216315:1876835055504256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892663.515734:0:216315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216315:1876835055504384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892663.515759:0:216315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.515783:0:216315:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.515809:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055504384 00000100:00100000:3.0:1789892663.515822:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055504384 00000100:00100000:3.0:1789892663.515855:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:3.0:1789892663.515865:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216315:x1876835055504384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892663.515943:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216315:x1876835055504384:12345-0@lo:502:llog_process_th.0 Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892663.515950:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:0.0:1789892663.515957:0:216315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216315:1876835055504384:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892663.515977:0:216315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:1.0:1789892663.516021:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:1.0:1789892663.516041:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892663.516054:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.516068:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892663.516073:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892663.516075:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 188 10000000:01000000:1.0:1789892663.516076:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892663.516086:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.516091:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.516097:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.516105:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.516124:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.516137:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.516155:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055504512 00000100:00100000:2.0:1789892663.516159:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055504512 00000100:00100000:2.0:1789892663.516178:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:2.0:1789892663.516183:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055504512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892663.516188:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892663.516195:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af4c3 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.516205:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.516212:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.516216:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382000, rc 0) 00000100:00100000:2.0:1789892663.516242:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055504512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.516246:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:1.0:1789892663.516266:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892663.516277:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892663.516283:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892663.516308:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.516327:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.516347:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.516353:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055504640 00000100:00100000:2.0:1789892663.516356:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055504640 00000100:00100000:2.0:1789892663.516374:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:2.0:1789892663.516378:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055504640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892663.516431:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055504640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.516441:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1789892663.516444:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.516467:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.516494:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.516507:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892663.516522:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055504768 00000100:00100000:0.0:1789892663.516526:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055504768 00000100:00100000:0.0:1789892663.516549:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1789892663.516556:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055504768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.516617:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055504768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892663.516623:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1789892663.516629:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055504768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892663.516793:0:216316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216316:1876835055504896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892663.516820:0:216316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.516838:0:216316:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.516871:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055504896 00000100:00100000:3.0:1789892663.516877:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055504896 00000100:00100000:3.0:1789892663.516910:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:3.0:1789892663.516921:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216316:x1876835055504896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892663.517024:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216316:x1876835055504896:12345-0@lo:502:llog_process_th.0 Request processed in 104us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892663.517034:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:1.0:1789892663.517041:0:216316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216316:1876835055504896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892663.517070:0:216316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892663.517076:0:216316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892663.517077:0:216316:0:(obd_config.c:1561:class_process_config()) marker 175 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:1.0:1789892663.517081:0:216316:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1789892663.517087:0:216316:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to qpool1 as member 1 00000020:01000000:2.0:1789892663.517305:0:216316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892663.517309:0:216316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892663.517311:0:216316:0:(obd_config.c:1561:class_process_config()) marker 175 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0000_UUID 00000020:01000000:2.0:1789892663.517314:0:216316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789892663.517315:0:216317:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789892663.517319:0:216317:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000020:00000080:2.0:1789892663.517320:0:216316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892663.517323:0:216316:0:(obd_config.c:1561:class_process_config()) marker 178 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789892663.517329:0:216316:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789892663.517335:0:216316:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 2 00000100:00100000:1.0:1789892663.517596:0:216316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216316:1876835055505024:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789892663.517597:0:216318:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789892663.517602:0:216318:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:1.0:1789892663.517628:0:216316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892663.517648:0:216316:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892663.517721:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055505024 00000100:00100000:3.0:1789892663.517728:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055505024 00000100:00100000:3.0:1789892663.517769:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:3.0:1789892663.517780:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216316:x1876835055505024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892663.517861:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216316:x1876835055505024:12345-0@lo:502:llog_process_th.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.517869:0:216316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216316:1876835055505024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892663.517873:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000020:01000000:1.0:1789892663.517890:0:216316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892663.517894:0:216316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892663.517895:0:216316:0:(obd_config.c:1561:class_process_config()) marker 178 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:1.0:1789892663.517898:0:216316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 194 count 190 00000020:01000000:0.0:1789892663.517944:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 188-193 (rc=0) 10000000:01000000:0.0:1789892663.517963:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789892663.517967:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.517974:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892663.517979:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789892663.517981:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:0.0:1789892663.517982:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789892663.517994:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.517999:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.518004:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892663.518021:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055505152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.518041:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.518080:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.518087:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055505152 00000100:00100000:2.0:1789892663.518092:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055505152 00000100:00100000:2.0:1789892663.518114:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:2.0:1789892663.518118:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055505152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892663.518123:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892663.518129:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af4d1 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.518141:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 24 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.518147:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 24 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892663.518153:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383400, rc 0) 00000100:00100000:2.0:1789892663.518178:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055505152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.518184:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1789892663.518197:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055505152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892663.518209:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.518214:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892663.518242:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055505280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892663.518267:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892663.518287:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892663.518298:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055505280 00000100:00100000:2.0:1789892663.518302:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055505280 00000100:00100000:2.0:1789892663.518321:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:2.0:1789892663.518325:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055505280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892663.518367:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055505280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 40us (99us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892663.518372:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1789892663.518382:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055505280:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789892663.518400:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789892663.518404:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892663.518409:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892663.995488:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892663.995533:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062738816 00000100:00100000:2.0:1789892663.995534:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892663.995545:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062738816 00000100:00100000:2.0:1789892663.995571:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892663.995571:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062738688 00000100:00100000:0.0:1789892663.995577:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062738688 00000100:00100000:1.0:1789892663.995626:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062738944 00000100:00100000:0.0:1789892663.995630:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2134 00000100:00100000:1.0:1789892663.995640:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062738944 00000100:00100000:0.0:1789892663.995643:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2394:x1876835062738688:12345-192.168.203.53@tcp:400:kworker.0 00000100:00080000:2.0:1789892663.995662:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789892663.995668:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789892663.995712:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 479 00000100:00100000:2.0:1789892663.995726:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 480 00000100:00100000:1.0:1789892663.995728:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2395:x1876835062738816:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1789892663.995729:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2394:x1876835062738688:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.995745:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2394:x1876835062738944:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1789892663.995746:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2134 00000100:00100000:1.0:1789892663.995780:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2395:x1876835062738816:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892663.995788:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 479 00000100:00100000:2.0:1789892663.995795:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2394:x1876835062738944:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892663.995806:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 480 00000100:00100000:3.0:1789892664.031066:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892664.031122:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062739072 00000100:00100000:0.0:1789892664.031131:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062739072 00000100:00100000:0.0:1789892664.031181:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2793 00000100:00100000:0.0:1789892664.031190:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215406:x1876835062739072:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:0.0:1789892664.032887:0:190670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:190670:1876835055505408:0@lo:19:mdt00_001.0 00000100:00100000:0.0:1789892664.032946:0:190670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.032985:0:190670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:190670:1876835055505536:0@lo:19:mdt00_001.0 00000100:00100000:0.0:1789892664.033015:0:190670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.033034:0:190670:0:(client.c:2702:ptlrpc_set_wait()) set ffff90318582eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.033183:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055505408 00000100:00100000:2.0:1789892664.033188:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055505408 00000100:00100000:2.0:1789892664.033222:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055505536 00000100:00100000:2.0:1789892664.033224:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055505536 00000100:00100000:2.0:1789892664.033257:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789892664.033269:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:190670:x1876835055505408:12345-0@lo:19:mdt00_001.0 00000100:00100000:0.0:1789892664.033270:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789892664.033285:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:190670:x1876835055505536:12345-0@lo:19:mdt00_001.0 00000100:00100000:2.0:1789892664.033440:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:190670:x1876835055505408:12345-0@lo:19:mdt00_001.0 Request processed in 176us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.033447:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789892664.033455:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:190670:x1876835055505536:12345-0@lo:19:mdt00_001.0 Request processed in 173us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892664.033462:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789892664.033472:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789892664.033473:0:190670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:190670:1876835055505408:0@lo:19:mdt00_001.0 00000100:00100000:3.0:1789892664.033488:0:190670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:190670:1876835055505536:0@lo:19:mdt00_001.0 00000100:00100000:3.0:1789892664.033562:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215406:x1876835062739072:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 2374us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.033575:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2793 00000100:00100000:3.0:1789892664.034452:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892664.034478:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062739200 00000100:00100000:3.0:1789892664.034482:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062739200 00000100:00100000:3.0:1789892664.034515:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2794 00000100:00100000:3.0:1789892664.034524:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215406:x1876835062739200:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:2.0:1789892664.036334:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215406:x1876835062739200:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1810us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.036342:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2794 00000020:00000080:1.0:1789892664.335961:0:216418:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc7a07b720 20000000:00000080:1.0:1789892664.335976:0:216418:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90319ee83000 uarg=0000000000000000 00000040:00100000:1.0:1789892664.336541:0:216418:0:(llog.c:1072:llog_reverse_process()) index 167 : idx 137 20000000:01000000:1.0:1789892664.336549:0:216418:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 157 cmd:0xce023 lustre.qpool2 00000040:00080000:1.0:1789892664.336621:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].168, 224 off38880 20000000:01000000:1.0:1789892664.336635:0:216418:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:1.0:1789892664.336648:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].169, 104 off38984 00000040:00080000:1.0:1789892664.336659:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].170, 224 off39208 00000040:00080000:1.0:1789892664.336729:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].194, 224 off43672 20000000:01000000:1.0:1789892664.336737:0:216418:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:1.0:1789892664.336747:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].195, 112 off43784 00000040:00080000:1.0:1789892664.336760:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].196, 224 off44008 00000040:00080000:1.0:1789892664.336805:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].194, 224 off43672 20000000:01000000:1.0:1789892664.336811:0:216418:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:1.0:1789892664.336821:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].195, 112 off43784 00000040:00080000:1.0:1789892664.336832:0:216418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].196, 224 off44008 10000000:01000000:1.0:1789892664.336840:0:216418:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892664.336859:0:216418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336884:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336895:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336915:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336921:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336926:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336931:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336936:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336941:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336946:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336952:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336957:0:216418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.336963:0:216418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.337007:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.337019:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 23 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.337032:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055505664:0@lo:104: 00000100:00100000:1.0:1789892664.337105:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892664.337148:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.337155:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 23 pid: 194990 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.337162:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bda680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055505792:0@lo:104: 00000100:00100000:1.0:1789892664.337181:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892664.337203:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055505664 00010000:00010000:1.0:1789892664.337208:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892664.337213:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055505664 00010000:00010000:1.0:1789892664.337218:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 23 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.337226:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055505792 00000100:00100000:1.0:1789892664.337228:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055505920:0@lo:104: 00000100:00100000:3.0:1789892664.337235:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055505792 00000100:00100000:1.0:1789892664.337254:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892664.337277:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055505920 00000100:00100000:2.0:1789892664.337283:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055505920 00010000:00010000:1.0:1789892664.337291:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.337296:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00010000:00010000:1.0:1789892664.337308:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 23 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.337315:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216418:x1876835055505664:12345-0@lo:104: 00000100:00100000:2.0:1789892664.337321:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00010000:00010000:3.0:1789892664.337339:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892664.337340:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216418:x1876835055505792:12345-0@lo:104: 00000100:00100000:1.0:1789892664.337341:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506048:0@lo:104: 00000100:00100000:0.0:1789892664.337350:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00010000:00010000:2.0:1789892664.337362:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.337372:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216418:x1876835055505920:12345-0@lo:104: 00000100:00100000:1.0:1789892664.337382:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892664.337385:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.337413:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.337421:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 23 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.337431:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506176:0@lo:104: 00010000:00010000:3.0:1789892664.337448:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892664.337455:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216418:x1876835055505664:12345-0@lo:104: Request processed in 146us (350us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892664.337456:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892664.337469:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216418:x1876835055505792:12345-0@lo:104: Request processed in 134us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.337475:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00010000:00010000:0.0:1789892664.337476:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892664.337481:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.337490:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216418:x1876835055505920:12345-0@lo:104: Request processed in 124us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.337495:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1789892664.337505:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055506048 00000100:00100000:3.0:1789892664.337512:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055506048 00010000:00010000:1.0:1789892664.337513:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892664.337518:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055506176 00000100:00100000:0.0:1789892664.337523:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789892664.337527:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055506176 00010000:00010000:1.0:1789892664.337532:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 23 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.337544:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506304:0@lo:104: 00000100:00100000:3.0:1789892664.337548:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789892664.337559:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1789892664.337565:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216418:x1876835055506048:12345-0@lo:104: 00010000:00010000:3.0:1789892664.337575:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.337580:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216418:x1876835055506176:12345-0@lo:104: 00000100:00100000:1.0:1789892664.337581:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892664.337582:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892664.337593:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.337599:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.337604:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892664.337612:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.337618:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.337627:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.337632:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 23 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.337639:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:2.0:1789892664.337642:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.337653:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216418:x1876835055506048:12345-0@lo:104: Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892664.337654:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506432:0@lo:104: 00010000:00010000:0.0:1789892664.337661:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:01000000:2.0:1789892664.337672:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892664.337674:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216418:x1876835055506176:12345-0@lo:104: Request processed in 103us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.337709:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789892664.337721:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789892664.337728:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892664.337740:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.337748:0:190653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789892664.337749:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892664.337760:0:190654:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1789892664.337766:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055506304 00000100:00100000:0.0:1789892664.337770:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055506304 00000100:00100000:3.0:1789892664.337773:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055506432 00010000:00010000:1.0:1789892664.337776:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.337777:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.337779:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055506432 00000100:00100000:0.0:1789892664.337797:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00010000:00010000:2.0:1789892664.337801:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af4d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4d8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.337813:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216418:x1876835055506304:12345-0@lo:104: 00000100:00100000:3.0:1789892664.337820:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00010000:00010000:0.0:1789892664.337837:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.337840:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 23 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.337841:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1789892664.337842:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bbaec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216418:x1876835055506432:12345-0@lo:104: 00010000:00010000:2.0:1789892664.337850:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.337861:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.337878:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7800 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892664.337882:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.337886:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506688:0@lo:104: 00010000:00010000:2.0:1789892664.337893:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892664.337901:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.337901:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:01000000:2.0:1789892664.337913:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892664.337914:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216418:x1876835055506304:12345-0@lo:104: Request processed in 105us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892664.337920:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789892664.337932:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1789892664.337933:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bbaec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216418:x1876835055506432:12345-0@lo:104: Request processed in 97us (206us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892664.337935:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.337941:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892664.337955:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00010000:00010000:2.0:1789892664.337955:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892664.337956:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789892664.337963:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.337973:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99a00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892664.337985:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892664.337986:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.337995:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055506688 00000100:00100000:3.0:1789892664.338002:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055506688 00010000:00010000:1.0:1789892664.338002:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338007:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62af4c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ca expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338015:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338025:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00010000:00010000:1.0:1789892664.338052:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 23 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338053:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216418:x1876835055506688:12345-0@lo:104: 10000000:00010000:0.0:1789892664.338057:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338059:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789892664.338067:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.338072:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338097:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506944:0@lo:104: 10000000:01000000:0.0:1789892664.338108:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892664.338111:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892664.338118:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338129:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338137:0:216418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789892664.338139:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338145:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892664.338146:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892664.338158:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892664.338167:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1789892664.338173:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338174:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338175:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338176:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216418:x1876835055506688:12345-0@lo:104: Request processed in 139us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.338199:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00010000:00010000:2.0:1789892664.338204:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892664.338208:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 9 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338213:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af4b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4bc expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338217:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055506944 00010000:00010000:2.0:1789892664.338218:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338224:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055506944 00000100:00100000:1.0:1789892664.338225:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055507200:192.168.203.53@tcp:104: 00010000:00010000:2.0:1789892664.338242:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af4a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ae expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338247:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00010000:00010000:0.0:1789892664.338253:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1789892664.338259:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216418:x1876835055506944:12345-0@lo:104: 00010000:00010000:0.0:1789892664.338261:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338274:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892664.338283:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338283:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338284:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892664.338289:0:216418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892664.338295:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338315:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892664.338322:0:216418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 9 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892664.338323:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338326:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.338338:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1789892664.338350:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338352:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216418:x1876835055506944:12345-0@lo:104: Request processed in 93us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892664.338355:0:216418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055507456:192.168.203.53@tcp:104: 00000100:00100000:3.0:1789892664.338375:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 10000000:00010000:2.0:1789892664.338378:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892664.338393:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892664.338396:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.338401:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789892664.338409:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338410:0:216418:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89540 going to sleep for 11 seconds 10000000:01000000:0.0:1789892664.338410:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892664.338413:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.338433:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7000 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892664.338433:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892664.338438:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055505664:0@lo:104: 10000000:00010000:3.0:1789892664.338441:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338444:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338446:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338451:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bda680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055505792:0@lo:104: 00010000:00010000:3.0:1789892664.338454:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338467:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055505920:0@lo:104: 00010000:00010000:2.0:1789892664.338471:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99800/0xd5b980e0d62af48b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af492 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338480:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1789892664.338484:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338485:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506048:0@lo:104: 00010000:00010000:0.0:1789892664.338496:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338497:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:3.0:1789892664.338500:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892664.338504:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506176:0@lo:104: 00010000:00010000:2.0:1789892664.338505:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338520:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506304:0@lo:104: 00010000:00010000:3.0:1789892664.338524:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338528:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62af499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4a0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338535:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506432:0@lo:104: 00010000:00010000:3.0:1789892664.338550:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892664.338552:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506688:0@lo:104: 00010000:00010000:2.0:1789892664.338557:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98e00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892664.338562:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892664.338564:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338572:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055506944:0@lo:104: 00010000:00010000:0.0:1789892664.338573:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892664.338579:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62af47d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af484 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338584:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338587:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338613:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7e00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:1.0:1789892664.338614:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055507328:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789892664.338617:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.338618:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892664.338623:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789892664.338624:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.338627:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789892664.338641:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892664.338649:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892664.338651:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.338652:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789892664.338665:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338671:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.338675:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 10000000:01000000:0.0:1789892664.338676:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892664.338682:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055506816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892664.338687:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055506560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892664.338690:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892664.338736:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338744:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af46f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af476 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338754:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892664.338757:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.338760:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892664.338766:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892664.338772:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892664.338772:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892664.338778:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892664.338790:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055507072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892664.338791:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338802:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055507712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892664.338807:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af468 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338835:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892664.338840:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892664.338842:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892664.338848:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892664.338849:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055508096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892664.338871:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055507328 00000100:00100000:2.0:1789892664.338877:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055507840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892664.338878:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055507328 00000100:00100000:3.0:1789892664.338886:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892664.338917:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 24 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.338923:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789892664.338931:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892664.338937:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055507968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892664.338961:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055506816 00000100:00100000:0.0:1789892664.338962:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055507072 00000100:00100000:1.0:1789892664.338968:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055506816 00000100:00100000:0.0:1789892664.338971:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055507072 00010000:00010000:1.0:1789892664.338988:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 26 pid: 194990 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.338996:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 26 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.339008:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055508096 00000100:00100000:1.0:1789892664.339014:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055508096 00000100:00100000:0.0:1789892664.339025:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055507840 00000100:00100000:3.0:1789892664.339032:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892664.339033:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 27 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.339033:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055507840 00000100:00100000:2.0:1789892664.339056:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055507968 00000100:00100000:2.0:1789892664.339062:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055507968 00000100:00100000:1.0:1789892664.339075:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00010000:00010000:0.0:1789892664.339082:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 29 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339085:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 29 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.339096:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1789892664.339098:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3618:x1876835055507328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892664.339118:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892664.339120:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3620:x1876835055506816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892664.339127:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 29 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892664.339132:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00010000:00010000:3.0:1789892664.339136:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892664.339145:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00010000:00010000:3.0:1789892664.339151:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 29 pid: 194990 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892664.339152:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3621:x1876835055507072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892664.339152:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 29 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.339167:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3619:x1876835055508096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892664.339171:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892664.339182:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 29 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.339189:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383200/0xd5b980e0d62af4ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af4a7 expref: 29 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.339190:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892664.339193:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 29 pid: 194990 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.339212:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 28 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339213:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 28 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.339233:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892664.339242:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382000/0xd5b980e0d62af4ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af4c3 expref: 28 pid: 194990 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339247:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9da00/0xd5b980e0d62af4bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af4b5 expref: 28 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.339251:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 28 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.339264:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3618:x1876835055507328:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (614us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892664.339277:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892664.339278:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00010000:00010000:0.0:1789892664.339289:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af461 expref: 27 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.339302:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00010000:00010000:0.0:1789892664.339306:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892664.339314:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3619:x1876835055507968:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892664.339324:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3621:x1876835055507072:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (487us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892664.339330:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892664.339331:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892664.339335:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00010000:00010000:1.0:1789892664.339339:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 24 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.339350:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 24 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.339362:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383a00/0xd5b980e0d62af476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af46f expref: 23 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892664.339368:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1789892664.339375:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3619:x1876835055508096:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (488us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892664.339383:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892664.339384:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3620:x1876835055506816:12345-0@lo:103:ldlm_bl.0 Request processed in 269us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.339387:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3621:x1876835055507840:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892664.339399:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00010000:00010000:2.0:1789892664.339402:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892664.339410:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00010000:00010000:2.0:1789892664.339411:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 22 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.339421:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3619:x1876835055507968:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (392us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892664.339425:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 21 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.339444:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1789892664.339453:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892664.339468:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af47d expref: 19 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.339468:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055507968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892664.339476:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055506560 00000100:00100000:3.0:1789892664.339484:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055507584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892664.339484:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055506560 00010000:00010000:2.0:1789892664.339490:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892664.339500:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055508096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892664.339509:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 19 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.339530:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892664.339539:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3621:x1876835055507840:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892664.339543:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055507584 00000100:00100000:1.0:1789892664.339548:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055507584 00000100:00100000:2.0:1789892664.339550:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1789892664.339560:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00010000:00010000:1.0:1789892664.339564:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 20 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.339571:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055507328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892664.339580:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3618:x1876835055506560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892664.339592:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892664.339597:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00010000:00010000:0.0:1789892664.339603:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 19 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892664.339612:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3618:x1876835055507584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892664.339628:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892664.339634:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 19 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339635:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 19 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.339637:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055507072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892664.339651:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892664.339657:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055507840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892664.339672:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 19 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.339721:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af4d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af4d1 expref: 19 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339723:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383000/0xd5b980e0d62af492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af48b expref: 19 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339745:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892664.339751:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892664.339799:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3618:x1876835055507584:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.339807:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1789892664.339820:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3618:x1876835055506560:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.339824:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055507712 00000100:00100000:2.0:1789892664.339829:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055507712 00000100:00100000:0.0:1789892664.339836:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00010000:00010000:2.0:1789892664.339844:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 17 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892664.339878:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1789892664.339886:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309ee11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3620:x1876835055507712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892664.339894:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892664.339898:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 16 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339907:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 16 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339916:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af499 expref: 16 pid: 190664 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.339926:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892664.339947:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055506560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892664.339960:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309ee11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3620:x1876835055507712:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.339968:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1789892664.339974:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055507584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892664.340010:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055507712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892664.340058:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055506816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892664.340116:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055507200:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892664.340117:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892664.340138:0:216418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216418:1876835055507456:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892664.340152:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892664.340165:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062739456 00000100:00100000:0.0:1789892664.340171:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062739456 00010000:00010000:0.0:1789892664.340192:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 10 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.340211:0:216418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.340220:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062739328 00000100:00100000:0.0:1789892664.340225:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 508 00000100:00100000:3.0:1789892664.340227:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062739328 00000100:00100000:0.0:1789892664.340237:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062739456:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892664.340246:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892664.340249:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 11 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.340254:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 11 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.340267:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 11 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.340279:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603bb expref: 11 pid: 190663 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.340287:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 509 00010000:00010000:0.0:1789892664.340290:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892664.340299:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062739328:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892664.340308:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892664.340313:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 10 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.340326:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2396:x1876835062739456:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 90us (208us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892664.340327:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 10 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.340346:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 508 00010000:00010000:3.0:1789892664.340352:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af45a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c2 expref: 10 pid: 190662 timeout: 3454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340367:0:190656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340381:0:190656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340393:0:190656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340398:0:190656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340443:0:190656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340449:0:190656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340454:0:190656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6800 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:3.0:1789892664.340457:0:190656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340462:0:190656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340475:0:190656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.340482:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892664.340512:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2397:x1876835062739328:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 216us (362us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892664.340512:0:216418:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892664.340529:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 509 00010000:00010000:1.0:1789892664.340536:0:216418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.340547:0:216418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af4df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.401889:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892664.537772:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892664.537779:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 168 10000000:01000000:1.0:1789892664.537785:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892664.537837:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.537850:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.537861:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.537886:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.537956:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.538000:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.538097:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055508224 00000100:00100000:3.0:1789892664.538106:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055508224 00000100:00100000:3.0:1789892664.538165:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:3.0:1789892664.538174:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055508224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892664.538188:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892664.538201:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af4e6 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.538225:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.538235:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.538244:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d200, rc 0) 00000100:00100000:3.0:1789892664.538294:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055508224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.538301:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:1.0:1789892664.538358:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892664.538375:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.538385:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.538451:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.538488:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.538509:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.538553:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055508352 00000100:00100000:2.0:1789892664.538562:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055508352 00000100:00100000:2.0:1789892664.538615:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1789892664.538626:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055508352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892664.538834:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055508352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.538846:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:1.0:1789892664.538866:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.538900:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.538954:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.538978:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.539065:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055508480 00000100:00100000:3.0:1789892664.539072:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055508480 00000100:00100000:3.0:1789892664.539107:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:3.0:1789892664.539114:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055508480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.539214:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055508480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.539222:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:1.0:1789892664.539256:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.539605:0:216419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216419:1876835055508608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.539640:0:216419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.539660:0:216419:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892664.539709:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055508608 00000100:00100000:0.0:1789892664.539725:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055508608 00000100:00100000:0.0:1789892664.539785:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:0.0:1789892664.539801:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216419:x1876835055508608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892664.539948:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216419:x1876835055508608:12345-0@lo:502:llog_process_th.0 Request processed in 151us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892664.539962:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:1.0:1789892664.539981:0:216419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216419:1876835055508608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.540030:0:216419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216419:1876835055508736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.540107:0:216419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.540141:0:216419:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.540172:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055508736 00000100:00100000:2.0:1789892664.540188:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055508736 00000100:00100000:2.0:1789892664.540234:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1789892664.540244:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216419:x1876835055508736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892664.540365:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216419:x1876835055508736:12345-0@lo:502:llog_process_th.0 Request processed in 121us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.540377:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:1.0:1789892664.540422:0:216419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216419:1876835055508736:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892664.540459:0:216419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:0.0:1789892664.540573:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:0.0:1789892664.540611:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892664.540622:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.540642:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892664.540654:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789892664.540656:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789892664.540661:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892664.540711:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.540724:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.540735:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.540757:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.540798:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.540835:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.540872:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055508864 00000100:00100000:2.0:1789892664.540881:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055508864 00000100:00100000:2.0:1789892664.540932:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1789892664.540941:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055508864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892664.540953:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892664.540967:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af4f4 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.540990:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.541003:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.541013:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382200, rc 0) 00000100:00100000:2.0:1789892664.541098:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055508864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.541107:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:0.0:1789892664.541144:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892664.541165:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.541178:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.541238:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.541274:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.541301:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.541343:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055508992 00000100:00100000:3.0:1789892664.541350:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055508992 00000100:00100000:3.0:1789892664.541384:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:3.0:1789892664.541407:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055508992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.541509:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055508992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.541517:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:0.0:1789892664.541563:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055508992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.541601:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.541649:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.541708:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.541721:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055509120 00000100:00100000:3.0:1789892664.541729:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055509120 00000100:00100000:3.0:1789892664.541766:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:3.0:1789892664.541774:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055509120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.541868:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055509120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.541876:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1789892664.541902:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892664.542947:0:216420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:1.0:1789892664.543102:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:1.0:1789892664.543130:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892664.543138:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.543152:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892664.543163:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892664.543165:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 168 10000000:01000000:1.0:1789892664.543167:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892664.543185:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.543203:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.543211:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.543224:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.543254:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.543287:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.543307:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055509248 00000100:00100000:2.0:1789892664.543313:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055509248 00000100:00100000:2.0:1789892664.543344:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1789892664.543350:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055509248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892664.543368:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892664.543377:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af502 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.543393:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 18 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.543402:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 18 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.543409:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383000, rc 0) 00000100:00100000:2.0:1789892664.543445:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055509248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.543451:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:1.0:1789892664.543509:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892664.543523:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.543531:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.543569:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.543595:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.543615:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.543651:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055509376 00000100:00100000:2.0:1789892664.543658:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055509376 00000100:00100000:2.0:1789892664.543721:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:2.0:1789892664.543731:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055509376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892664.543829:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055509376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.543842:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:1.0:1789892664.543851:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.543886:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.543926:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.543954:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.543972:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055509504 00000100:00100000:3.0:1789892664.543980:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055509504 00000100:00100000:3.0:1789892664.544014:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:3.0:1789892664.544021:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055509504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.544141:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055509504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.544149:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:1.0:1789892664.544178:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.544526:0:216421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216421:1876835055509632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.544572:0:216421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.544593:0:216421:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.544631:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055509632 00000100:00100000:3.0:1789892664.544638:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055509632 00000100:00100000:3.0:1789892664.544667:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:3.0:1789892664.544674:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216421:x1876835055509632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892664.544825:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216421:x1876835055509632:12345-0@lo:502:llog_process_th.0 Request processed in 148us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.544834:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:1.0:1789892664.544839:0:216421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216421:1876835055509632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.544892:0:216421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216421:1876835055509760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.544931:0:216421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.544960:0:216421:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.544980:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055509760 00000100:00100000:2.0:1789892664.544987:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055509760 00000100:00100000:2.0:1789892664.545019:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1789892664.545026:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216421:x1876835055509760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892664.545137:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216421:x1876835055509760:12345-0@lo:502:llog_process_th.0 Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.545155:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:1.0:1789892664.545175:0:216421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216421:1876835055509760:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892664.545207:0:216421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:0.0:1789892664.545269:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:0.0:1789892664.545297:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892664.545304:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.545314:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892664.545322:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789892664.545323:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:0.0:1789892664.545325:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892664.545351:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.545358:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.545365:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.545378:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.545408:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.545431:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.545469:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055509888 00000100:00100000:2.0:1789892664.545476:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055509888 00000100:00100000:2.0:1789892664.545511:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:2.0:1789892664.545517:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055509888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892664.545525:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892664.545533:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af510 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.545547:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.545555:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.545561:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382a00, rc 0) 00000100:00100000:2.0:1789892664.545609:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055509888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.545621:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1789892664.545637:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055509888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892664.545654:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.545663:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.545723:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.545748:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.545774:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.545795:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055510016 00000100:00100000:3.0:1789892664.545802:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055510016 00000100:00100000:3.0:1789892664.545866:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:3.0:1789892664.545876:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055510016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.545973:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055510016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.545982:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1789892664.546009:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.546060:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.546116:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.546135:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.546160:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055510144 00000100:00100000:3.0:1789892664.546165:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055510144 00000100:00100000:3.0:1789892664.546189:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:3.0:1789892664.546194:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055510144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.546275:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055510144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.546281:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:0.0:1789892664.546310:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892664.547172:0:216422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:1.0:1789892664.547227:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:1.0:1789892664.547264:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892664.547270:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.547278:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892664.547289:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892664.547292:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 168 10000000:01000000:1.0:1789892664.547295:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892664.547316:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.547327:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.547338:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.547365:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.547391:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.547416:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.547453:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055510272 00000100:00100000:2.0:1789892664.547461:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055510272 00000100:00100000:2.0:1789892664.547499:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1789892664.547508:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055510272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892664.547517:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892664.547528:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af51e expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.547546:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 20 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.547585:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 20 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.547597:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382800, rc 0) 00000100:00100000:2.0:1789892664.547653:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055510272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.547667:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:1.0:1789892664.547717:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892664.547734:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.547744:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.547786:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.547813:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.547839:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.547861:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055510400 00000100:00100000:2.0:1789892664.547867:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055510400 00000100:00100000:2.0:1789892664.547898:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1789892664.547905:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055510400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892664.547996:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055510400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.548006:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:1.0:1789892664.548028:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.548080:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.548119:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.548139:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.548167:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055510528 00000100:00100000:3.0:1789892664.548175:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055510528 00000100:00100000:3.0:1789892664.548215:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:3.0:1789892664.548224:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055510528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.548319:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055510528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.548328:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:1.0:1789892664.548364:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.548664:0:216423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216423:1876835055510656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.548749:0:216423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.548773:0:216423:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.548801:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055510656 00000100:00100000:3.0:1789892664.548807:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055510656 00000100:00100000:3.0:1789892664.548842:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:3.0:1789892664.548848:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216423:x1876835055510656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892664.548940:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216423:x1876835055510656:12345-0@lo:502:llog_process_th.0 Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.548949:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:1.0:1789892664.548959:0:216423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216423:1876835055510656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.549013:0:216423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216423:1876835055510784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.549077:0:216423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.549095:0:216423:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.549138:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055510784 00000100:00100000:2.0:1789892664.549148:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055510784 00000100:00100000:2.0:1789892664.549195:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1789892664.549208:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216423:x1876835055510784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892664.549332:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216423:x1876835055510784:12345-0@lo:502:llog_process_th.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.549344:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:1.0:1789892664.549373:0:216423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216423:1876835055510784:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892664.549403:0:216423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:0.0:1789892664.549493:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:0.0:1789892664.549525:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892664.549535:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.549548:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892664.549561:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789892664.549564:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 194 10000000:01000000:0.0:1789892664.549567:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892664.549589:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.549602:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.549614:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.549650:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.549688:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892664.549759:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055510912 00000100:00100000:0.0:1789892664.549781:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.549784:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055510912 00000100:00100000:2.0:1789892664.549831:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:2.0:1789892664.549844:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055510912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892664.549869:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892664.549882:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af52c expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.549902:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.549915:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.549927:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383c00, rc 0) 00000100:00100000:2.0:1789892664.549975:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055510912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.549985:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:0.0:1789892664.550020:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055510912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892664.550073:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.550083:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.550126:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.550151:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.550170:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.550182:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055511040 00000100:00100000:3.0:1789892664.550186:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055511040 00000100:00100000:3.0:1789892664.550207:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:3.0:1789892664.550211:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055511040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.550267:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055511040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.550274:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00100000:0.0:1789892664.550291:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.550320:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.550357:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.550396:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.550412:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055511168 00000100:00100000:3.0:1789892664.550417:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055511168 00000100:00100000:3.0:1789892664.550443:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1789892664.550449:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055511168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.550529:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055511168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.550536:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00100000:0.0:1789892664.550573:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.550820:0:216424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216424:1876835055511296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892664.550856:0:216424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.550884:0:216424:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba13c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.550887:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055511296 00000100:00100000:2.0:1789892664.550893:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055511296 00000100:00100000:2.0:1789892664.550947:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:2.0:1789892664.550956:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216424:x1876835055511296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892664.551105:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216424:x1876835055511296:12345-0@lo:502:llog_process_th.0 Request processed in 150us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.551112:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:0.0:1789892664.551137:0:216424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216424:1876835055511296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892664.551163:0:216424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892664.551174:0:216424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892664.551176:0:216424:0:(obd_config.c:1561:class_process_config()) marker 182 (0x1) lustre-MDT0001-m new lustre.qpool2 00000020:00000080:0.0:1789892664.551197:0:216424:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1789892664.551266:0:216424:0:(lod_pool.c:475:lod_pool_new()) qpool2 is pool #2 00000100:00100000:0.0:1789892664.551293:0:216424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216424:1876835055511424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892664.551343:0:216424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.551371:0:216424:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.551400:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055511424 00000100:00100000:2.0:1789892664.551408:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055511424 00000100:00100000:2.0:1789892664.551448:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:2.0:1789892664.551458:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216424:x1876835055511424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892664.551563:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216424:x1876835055511424:12345-0@lo:502:llog_process_th.0 Request processed in 105us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892664.551588:0:216424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216424:1876835055511424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892664.551590:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000020:01000000:0.0:1789892664.551640:0:216424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892664.551646:0:216424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892664.551654:0:216424:0:(obd_config.c:1561:class_process_config()) marker 182 (0x2) lustre-MDT0001-m new lustre.qpool2 00000040:00080000:0.0:1789892664.551658:0:216424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 197 count 193 00000020:01000000:1.0:1789892664.551717:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 194-196 (rc=0) 10000000:01000000:1.0:1789892664.551733:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892664.551738:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.551745:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892664.551751:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892664.551753:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 168 10000000:01000000:1.0:1789892664.551755:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892664.551766:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.551771:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.551776:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.551785:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.551805:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.551822:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.551877:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055511552 00000100:00100000:3.0:1789892664.551882:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055511552 00000100:00100000:3.0:1789892664.551909:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1789892664.551914:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055511552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892664.551922:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892664.551929:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af53a expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.551942:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.551949:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.551963:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c200, rc 0) 00000100:00100000:3.0:1789892664.551995:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055511552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.552001:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00100000:1.0:1789892664.552018:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892664.552047:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.552054:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.552081:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.552101:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.552114:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.552133:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055511680 00000100:00100000:3.0:1789892664.552138:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055511680 00000100:00100000:3.0:1789892664.552158:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:3.0:1789892664.552163:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055511680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892664.552221:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055511680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.552226:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:1.0:1789892664.552246:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.552265:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.552298:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.552317:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.552329:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055511808 00000100:00100000:2.0:1789892664.552333:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055511808 00000100:00100000:2.0:1789892664.552355:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1789892664.552359:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055511808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892664.552412:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055511808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.552419:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:1.0:1789892664.552437:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055511808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.552645:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216425:1876835055511936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.552682:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892664.552729:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055511936 00000100:00100000:2.0:1789892664.552735:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055511936 00000100:00100000:1.0:1789892664.552744:0:216425:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.552775:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1789892664.552784:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216425:x1876835055511936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892664.552870:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216425:x1876835055511936:12345-0@lo:502:llog_process_th.0 Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.552879:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:1.0:1789892664.552892:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216425:1876835055511936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.552937:0:216425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216425:1876835055512064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892664.552974:0:216425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.552993:0:216425:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.553007:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055512064 00000100:00100000:3.0:1789892664.553013:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055512064 00000100:00100000:3.0:1789892664.553053:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:3.0:1789892664.553061:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216425:x1876835055512064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892664.553141:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216425:x1876835055512064:12345-0@lo:502:llog_process_th.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.553148:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00100000:1.0:1789892664.553158:0:216425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216425:1876835055512064:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892664.553177:0:216425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:0.0:1789892664.553233:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:0.0:1789892664.553251:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892664.553259:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.553268:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892664.553275:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892664.553277:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 194 10000000:01000000:0.0:1789892664.553280:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892664.553295:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.553303:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.553311:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.553325:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.553353:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.553399:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.553412:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055512192 00000100:00100000:3.0:1789892664.553417:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055512192 00000100:00100000:3.0:1789892664.553446:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:3.0:1789892664.553451:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055512192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892664.553459:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892664.553467:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af548 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.553494:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.553503:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892664.553510:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9ce00, rc 0) 00000100:00100000:3.0:1789892664.553545:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055512192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.553551:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:0.0:1789892664.553591:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892664.553610:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892664.553622:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892664.553724:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.553768:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892664.553809:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055512320 00000100:00100000:2.0:1789892664.553816:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055512320 00000100:00100000:0.0:1789892664.553816:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.553851:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:2.0:1789892664.553859:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055512320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892664.553936:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055512320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.553944:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:0.0:1789892664.553971:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.554009:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.554092:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.554110:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.554126:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055512448 00000100:00100000:2.0:1789892664.554130:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055512448 00000100:00100000:2.0:1789892664.554150:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:2.0:1789892664.554154:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055512448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892664.554211:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055512448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.554217:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:0.0:1789892664.554237:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892664.554463:0:216426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216426:1876835055512576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892664.554513:0:216426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.554541:0:216426:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.554544:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055512576 00000100:00100000:3.0:1789892664.554551:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055512576 00000100:00100000:3.0:1789892664.554580:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:3.0:1789892664.554586:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216426:x1876835055512576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892664.554717:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216426:x1876835055512576:12345-0@lo:502:llog_process_th.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.554724:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:0.0:1789892664.554925:0:216426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216426:1876835055512576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892664.554951:0:216426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892664.554960:0:216426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892664.554963:0:216426:0:(obd_config.c:1561:class_process_config()) marker 181 (0x1) lustre-MDT0000-m new lustre.qpool2 00000020:00000080:0.0:1789892664.554970:0:216426:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1789892664.555011:0:216426:0:(lod_pool.c:475:lod_pool_new()) qpool2 is pool #2 00080000:10000000:0.0:1789892664.555713:0:216426:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x58:0x0] (8/32) registered 00080000:10000000:0.0:1789892664.557465:0:216426:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x59:0x0] (8/32) registered 00080000:10000000:0.0:1789892664.558915:0:216426:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5a:0x0] (8/32) registered 00000100:00100000:0.0:1789892664.560018:0:216426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216426:1876835055512704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892664.560099:0:216426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892664.560125:0:216426:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892664.560149:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055512704 00000100:00100000:3.0:1789892664.560156:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055512704 00000100:00100000:3.0:1789892664.560183:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:3.0:1789892664.560189:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216426:x1876835055512704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892664.560254:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216426:x1876835055512704:12345-0@lo:502:llog_process_th.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892664.560261:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:0.0:1789892664.560286:0:216426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216426:1876835055512704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892664.560313:0:216426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892664.560318:0:216426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892664.560319:0:216426:0:(obd_config.c:1561:class_process_config()) marker 181 (0x2) lustre-MDT0000-m new lustre.qpool2 00000040:00080000:0.0:1789892664.560323:0:216426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 197 count 193 00000020:01000000:1.0:1789892664.560405:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 194-196 (rc=0) 10000000:01000000:1.0:1789892664.560437:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892664.560447:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.560461:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892664.560474:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892664.560476:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:1.0:1789892664.560480:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892664.560501:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.560509:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.560516:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.560529:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.560560:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.560582:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.560630:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055512832 00000100:00100000:2.0:1789892664.560636:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055512832 00000100:00100000:2.0:1789892664.560668:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:2.0:1789892664.560699:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055512832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892664.560709:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892664.560722:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af556 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.560740:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.560752:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892664.560760:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383800, rc 0) 00000100:00100000:2.0:1789892664.560800:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055512832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892664.560809:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:1.0:1789892664.560816:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892664.560828:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.560834:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892664.560873:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892664.560910:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892664.560935:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892664.560964:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055512960 00000100:00100000:2.0:1789892664.560972:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055512960 00000100:00100000:2.0:1789892664.561009:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:2.0:1789892664.561019:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055512960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892664.561126:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055512960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (229us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892664.561142:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055512960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892664.561148:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 10000000:01000000:1.0:1789892664.561168:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892664.561174:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892664.561180:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892665.019813:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892665.019867:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062739584 00000100:00100000:3.0:1789892665.019877:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062739584 00000100:00100000:3.0:1789892665.019941:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2173 00000100:00100000:3.0:1789892665.019951:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062739584:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892665.019967:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892665.019982:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603c9 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892665.020007:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892665.020016:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892665.020024:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c800, rc 0) 00000100:00100000:3.0:1789892665.020113:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062739584:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 162us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892665.020123:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2173 00000100:00100000:0.0:1789892665.021062:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892665.021115:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062739712 00000100:00100000:3.0:1789892665.021121:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062739712 00000100:00100000:3.0:1789892665.021148:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2174 00000100:00100000:3.0:1789892665.021155:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062739712:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892665.021252:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062739712:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 98us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892665.021260:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2174 00000100:00100000:2.0:1789892665.021915:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892665.021968:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062739840 00000100:00100000:0.0:1789892665.021974:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062739840 00000100:00100000:0.0:1789892665.022010:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2175 00000100:00100000:0.0:1789892665.022021:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062739840:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892665.022132:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062739840:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 113us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892665.022140:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2175 00000100:00100000:2.0:1789892665.023381:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892665.023434:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062739968 00000100:00100000:0.0:1789892665.023441:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062739968 00000100:00100000:0.0:1789892665.023481:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2176 00000100:00100000:0.0:1789892665.023490:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215417:x1876835062739968:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892665.023580:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215417:x1876835062739968:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892665.023590:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2176 00000100:00100000:1.0:1789892665.024479:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892665.024520:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062740096 00000100:00100000:3.0:1789892665.024525:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062740096 00000100:00100000:3.0:1789892665.024549:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2177 00000100:00100000:3.0:1789892665.024555:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215417:x1876835062740096:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892665.024620:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215417:x1876835062740096:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 64us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892665.024625:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2177 00000100:00100000:2.0:1789892665.025613:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892665.025665:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062740224 00000100:00100000:1.0:1789892665.025671:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062740224 00000100:00100000:1.0:1789892665.025728:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2178 00000100:00100000:1.0:1789892665.025738:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062740224:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892665.025748:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892665.025759:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603d0 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892665.025777:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892665.025789:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892665.025811:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892665.025848:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062740224:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 111us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892665.025858:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2178 00000100:00100000:2.0:1789892665.026577:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892665.026627:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062740352 00000100:00100000:0.0:1789892665.026633:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062740352 00000100:00100000:0.0:1789892665.026662:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2179 00000100:00100000:0.0:1789892665.026670:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062740352:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892665.026759:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062740352:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 89us (181us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892665.026778:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2179 00010000:00010000:3.0:1789892665.425787:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789892666.017109:0:216523:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd43eaeb90 20000000:00000080:0.0:1789892666.017122:0:216523:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90309190d800 uarg=0000000000000000 00000040:00100000:0.0:1789892666.017650:0:216523:0:(llog.c:1072:llog_reverse_process()) index 170 : idx 137 20000000:01000000:0.0:1789892666.017656:0:216523:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 169 cmd:0xce020 lustre.qpool2 00000040:00080000:0.0:1789892666.017776:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].171, 224 off39432 20000000:01000000:0.0:1789892666.017801:0:216523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892666.017819:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].172, 128 off39560 00000040:00080000:0.0:1789892666.017831:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].173, 224 off39784 00000040:00080000:0.0:1789892666.017878:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].197, 224 off44232 20000000:01000000:0.0:1789892666.017885:0:216523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892666.017896:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].198, 136 off44368 00000040:00080000:0.0:1789892666.017906:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].199, 224 off44592 00000040:00080000:0.0:1789892666.017946:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].197, 224 off44232 20000000:01000000:0.0:1789892666.017952:0:216523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1789892666.017961:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].198, 136 off44368 00000040:00080000:0.0:1789892666.017971:0:216523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].199, 224 off44592 10000000:01000000:0.0:1789892666.017978:0:216523:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789892666.017994:0:216523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018009:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018015:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018020:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018051:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018056:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018061:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018066:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018070:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018075:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018081:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018086:0:216523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018092:0:216523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018123:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018142:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 9 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.018154:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513088:192.168.203.53@tcp:104: 00010000:00010000:0.0:1789892666.018239:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018246:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 9 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.018253:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513216:192.168.203.53@tcp:104: 00010000:00010000:0.0:1789892666.018276:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018281:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 23 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.018287:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513344:0@lo:104: 00000100:00100000:0.0:1789892666.018322:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892666.018354:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018360:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 23 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.018370:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513472:0@lo:104: 00000100:00100000:0.0:1789892666.018394:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892666.018443:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055513344 00010000:00010000:0.0:1789892666.018447:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.018449:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055513472 00000100:00100000:1.0:1789892666.018451:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055513344 00000100:00100000:3.0:1789892666.018456:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055513472 00010000:00010000:0.0:1789892666.018466:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 23 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.018479:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513600:0@lo:104: 00000100:00100000:1.0:1789892666.018505:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1789892666.018519:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892666.018520:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216523:x1876835055513344:12345-0@lo:104: 00000100:00100000:3.0:1789892666.018533:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055513600 00010000:00010000:1.0:1789892666.018535:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.018537:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055513600 00000100:00100000:2.0:1789892666.018543:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00010000:00010000:0.0:1789892666.018553:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.018561:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00010000:00010000:0.0:1789892666.018566:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 23 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.018568:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216523:x1876835055513472:12345-0@lo:104: 00010000:00010000:2.0:1789892666.018590:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.018590:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513728:0@lo:104: 00010000:00010000:1.0:1789892666.018593:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892666.018606:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216523:x1876835055513344:12345-0@lo:104: Request processed in 91us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.018617:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1789892666.018628:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:216523:x1876835055513600:12345-0@lo:104: 00010000:00010000:3.0:1789892666.018638:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.018638:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892666.018658:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892666.018672:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789892666.018674:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.018701:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892666.018705:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.018714:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.018716:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216523:x1876835055513472:12345-0@lo:104: Request processed in 157us (318us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892666.018719:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892666.018738:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.018740:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00010000:00010000:0.0:1789892666.018743:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 23 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.018762:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055513728 10000000:01000000:1.0:1789892666.018763:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892666.018769:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055513728 00000100:00100000:0.0:1789892666.018771:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513856:0@lo:104: 00010000:00010000:1.0:1789892666.018796:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.018799:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892666.018805:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00010000:00010000:1.0:1789892666.018812:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892666.018813:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216523:x1876835055513600:12345-0@lo:104: Request processed in 238us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.018823:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.018825:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216523:x1876835055513728:12345-0@lo:104: 00000100:00100000:3.0:1789892666.018828:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00010000:00010000:1.0:1789892666.018837:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.018842:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.018844:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af55d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.018849:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055513856 00010000:00010000:0.0:1789892666.018869:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.018873:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789892666.018877:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018879:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 23 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.018887:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892666.018892:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.018896:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055514112:0@lo:104: 00010000:00010000:1.0:1789892666.018900:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.018911:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:1.0:1789892666.018912:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.018918:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055513856 00000100:00100000:2.0:1789892666.018924:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216523:x1876835055513728:12345-0@lo:104: Request processed in 105us (286us total) trans 0 rc 0/0 10000000:01000000:1.0:1789892666.018925:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892666.018939:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789892666.018946:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.018949:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00010000:00010000:1.0:1789892666.018949:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.018958:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892666.018960:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055514112 00000100:00100000:3.0:1789892666.018962:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903091829850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216523:x1876835055513856:12345-0@lo:104: 00000100:00100000:2.0:1789892666.018974:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055514112 00010000:00010000:3.0:1789892666.018975:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.018976:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.018977:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.018998:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00010000:00010000:1.0:1789892666.019004:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98600/0xd5b980e0d62af548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af54f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.019009:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 23 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.019013:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216523:x1876835055514112:12345-0@lo:104: 00010000:00010000:1.0:1789892666.019038:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892666.019044:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019044:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019045:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055514368:0@lo:104: 00010000:00010000:3.0:1789892666.019052:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892666.019064:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903091829850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216523:x1876835055513856:12345-0@lo:104: Request processed in 103us (248us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892666.019071:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6c00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892666.019077:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019082:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.019083:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00010000:00010000:1.0:1789892666.019092:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892666.019099:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892666.019103:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892666.019114:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019123:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789892666.019126:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 23 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019127:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.019133:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055514368 00000100:00100000:2.0:1789892666.019134:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216523:x1876835055514112:12345-0@lo:104: Request processed in 122us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.019139:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055514368 00010000:00010000:1.0:1789892666.019152:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892666.019156:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1789892666.019161:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055514496:0@lo:104: 00000100:00100000:3.0:1789892666.019167:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00010000:00010000:1.0:1789892666.019172:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.019179:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216523:x1876835055514368:12345-0@lo:104: 00010000:00010000:2.0:1789892666.019181:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789892666.019183:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6c00/0xd5b980e0d62af53a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af541 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019192:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.019194:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019208:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892666.019225:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99c00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892666.019229:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:2.0:1789892666.019231:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019234:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.019249:0:216523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019257:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7400 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892666.019258:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892666.019262:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.019263:0:216523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 23 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892666.019279:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019287:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892666.019291:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892666.019292:0:216523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055514752:0@lo:104: 00010000:00010000:3.0:1789892666.019299:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:1.0:1789892666.019308:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.019309:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216523:x1876835055514368:12345-0@lo:104: Request processed in 134us (231us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892666.019318:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892666.019327:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892666.019328:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1789892666.019335:0:216523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892666.019339:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892666.019353:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055514496 00010000:00010000:2.0:1789892666.019353:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019356:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.019357:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055514496 00000100:00100000:0.0:1789892666.019359:0:216523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030821829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892666.019374:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055514752 00010000:00010000:1.0:1789892666.019377:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892666.019378:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055514752 00010000:00010000:2.0:1789892666.019381:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99c00/0xd5b980e0d62af52c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af533 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019386:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019391:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513344:0@lo:104: 00010000:00010000:1.0:1789892666.019395:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af51e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af525 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019396:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892666.019399:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00010000:00010000:2.0:1789892666.019405:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.019413:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216523:x1876835055514496:12345-0@lo:104: 00010000:00010000:1.0:1789892666.019415:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789892666.019415:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513472:0@lo:104: 00010000:00010000:1.0:1789892666.019423:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019425:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99a00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892666.019428:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892666.019436:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019439:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513600:0@lo:104: 00010000:00010000:1.0:1789892666.019465:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892666.019466:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892666.019469:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019473:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513728:0@lo:104: 10000000:00010000:2.0:1789892666.019493:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019494:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019498:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513856:0@lo:104: 00010000:00010000:3.0:1789892666.019514:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1789892666.019517:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789892666.019520:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.019524:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:216523:x1876835055514496:12345-0@lo:104: Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.019526:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055514112:0@lo:104: 00010000:00010000:2.0:1789892666.019538:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892666.019540:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892666.019546:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1789892666.019553:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055514368:0@lo:104: 00010000:00010000:2.0:1789892666.019555:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892666.019563:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019568:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.019569:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1789892666.019574:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055514496:0@lo:104: 00010000:00010000:1.0:1789892666.019579:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892666.019589:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019592:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99a00/0xd5b980e0d62af510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af517 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.019598:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62af502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af509 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019616:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892666.019618:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892666.019621:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892666.019622:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055513984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892666.019626:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216523:x1876835055514752:12345-0@lo:104: 00010000:00010000:1.0:1789892666.019627:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892666.019632:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.019639:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.019644:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055514240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.019645:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892666.019654:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892666.019702:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.019706:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309ee11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055514624:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789892666.019713:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892666.019719:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892666.019740:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019745:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892666.019748:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055515008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.019753:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.019755:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892666.019758:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.019768:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:216523:x1876835055514752:12345-0@lo:104: Request processed in 187us (437us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892666.019771:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af4f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4fb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.019780:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1789892666.019788:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892666.019789:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789892666.019793:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055515264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.019794:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.019800:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6800 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892666.019805:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.019806:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892666.019814:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892666.019827:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892666.019833:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.019843:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789892666.019844:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892666.019849:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892666.019875:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.019878:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789892666.019886:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055514752:0@lo:104: 00000100:00100000:1.0:1789892666.019889:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055514880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.019890:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892666.019913:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.019925:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892666.019929:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af4e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af4ed expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.019946:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513088:192.168.203.53@tcp:104: 00010000:00010000:2.0:1789892666.019955:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892666.019959:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055515392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.019961:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892666.019966:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892666.019967:0:216523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:216523:1876835055513216:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892666.019985:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055513984 00000100:00100000:1.0:1789892666.019991:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055514624 00000100:00100000:2.0:1789892666.019992:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055513984 00000100:00100000:1.0:1789892666.019996:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055514624 00000100:00100000:3.0:1789892666.020008:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:2.0:1789892666.020022:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 25 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.020023:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 25 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.020057:0:216523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.020063:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892666.020069:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055515008 00000100:00100000:1.0:1789892666.020074:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055515008 00000100:00100000:2.0:1789892666.020084:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055515264 00000100:00100000:3.0:1789892666.020089:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055514880 00010000:00010000:1.0:1789892666.020089:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 26 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.020092:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055515264 00000100:00100000:3.0:1789892666.020095:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055514880 00000100:00100000:0.0:1789892666.020104:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062740480 00000100:00100000:0.0:1789892666.020109:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062740480 00000100:00100000:1.0:1789892666.020114:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062740608 00000100:00100000:1.0:1789892666.020118:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062740608 00010000:00010000:3.0:1789892666.020122:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 28 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.020122:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 28 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.020131:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 11 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.020135:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 11 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.020161:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1789892666.020174:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3618:x1876835055514624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892666.020184:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892666.020188:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00010000:00010000:3.0:1789892666.020194:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 28 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.020198:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1789892666.020204:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3620:x1876835055513984:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892666.020212:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1789892666.020214:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3620:x1876835055515008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892666.020217:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 28 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.020220:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892666.020228:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3618:x1876835055514880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892666.020228:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892666.020230:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 28 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.020237:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 28 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.020242:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9c200/0xd5b980e0d62af541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af53a expref: 28 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.020242:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892666.020252:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 20 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 28 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.020269:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 28 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.020279:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 27 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.020299:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 27 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.020307:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892666.020316:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383800/0xd5b980e0d62af55d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af556 expref: 27 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.020323:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382800/0xd5b980e0d62af525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af51e expref: 27 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.020329:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af52c expref: 26 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.020331:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892666.020337:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892666.020339:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055514624:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (583us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892666.020347:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892666.020359:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1789892666.020381:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055513984:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.020388:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 514 00000100:00100000:1.0:1789892666.020395:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055515008:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.020399:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1789892666.020401:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3618:x1876835055514880:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.020403:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062740480:12345-192.168.203.53@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789892666.020417:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00010000:00010000:3.0:1789892666.020419:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892666.020426:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00010000:00010000:3.0:1789892666.020427:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 11 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.020436:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 515 00010000:00010000:3.0:1789892666.020442:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 11 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.020443:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1789892666.020451:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062740608:12345-192.168.203.53@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789892666.020459:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055515264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892666.020462:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892666.020463:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9c800/0xd5b980e0d62af564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603c9 expref: 11 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.020471:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892666.020474:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 10 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.020478:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892666.020479:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 20 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.020483:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055515520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892666.020509:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2396:x1876835062740480:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 111us (556us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892666.020511:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 10 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.020521:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.020526:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 514 00010000:00010000:1.0:1789892666.020540:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 20 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.020549:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055515520 00000100:00100000:3.0:1789892666.020554:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055515520 00010000:00010000:0.0:1789892666.020558:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af56b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d0 expref: 9 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.020559:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055513984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892666.020562:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383000/0xd5b980e0d62af509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af502 expref: 21 pid: 190663 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.020569:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 21 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.020579:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055515008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892666.020588:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892666.020593:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892666.020613:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1789892666.020627:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055515520:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892666.020627:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2397:x1876835062740608:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 178us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.020636:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055515264:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (795us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892666.020640:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892666.020643:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 515 00010000:00010000:3.0:1789892666.020649:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 20 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.020654:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00010000:00010000:0.0:1789892666.020668:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892666.020673:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 19 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.020707:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.020726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.020751:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055514240 00000100:00100000:1.0:1789892666.020754:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055515136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892666.020758:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055514240 00000100:00100000:0.0:1789892666.020775:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055514624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.020784:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 20 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.020785:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.020793:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055515264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892666.020810:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055515392 00000100:00100000:2.0:1789892666.020820:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055515392 00000100:00100000:1.0:1789892666.020829:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055515136 00000100:00100000:0.0:1789892666.020835:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055514880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.020836:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 21 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.020842:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055515136 00010000:00010000:1.0:1789892666.020882:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 22 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.020889:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1789892666.020903:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1789892666.020906:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3621:x1876835055514240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.020918:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892666.020921:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3618:x1876835055515392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892666.020945:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 22 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.020946:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00010000:00010000:0.0:1789892666.020956:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892666.020969:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 22 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892666.020970:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3621:x1876835055515136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892666.020989:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892666.020997:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 22 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.021145:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 22 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.021165:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 22 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021180:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 22 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.021196:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382200/0xd5b980e0d62af4fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af4f4 expref: 22 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021219:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62af517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af510 expref: 22 pid: 190664 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.021233:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892666.021248:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af4ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af4e6 expref: 20 pid: 194990 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021256:0:190657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.021258:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9ce00/0xd5b980e0d62af54f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af548 expref: 20 pid: 190662 timeout: 3456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021285:0:190657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.021287:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3618:x1876835055515392:12345-0@lo:103:ldlm_bl.0 Request processed in 369us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.021312:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00010000:00010000:3.0:1789892666.021313:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892666.021314:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892666.021318:0:190657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021330:0:190657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021338:0:190657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021346:0:190657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021361:0:190657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99600 already unused, calling callback (ffffffffc0d27250) 00000100:00100000:0.0:1789892666.021363:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055515392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892666.021370:0:190657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.021381:0:190657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.021387:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3620:x1876835055515520:12345-0@lo:103:ldlm_bl.0 Request processed in 762us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.021407:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1789892666.021407:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3621:x1876835055514240:12345-0@lo:103:ldlm_bl.0 Request processed in 501us (697us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892666.021414:0:190657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892666.021423:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309ee11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055514240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892666.021438:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00010000:00010000:1.0:1789892666.021449:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892666.021486:0:216523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.021502:0:216523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.021515:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055515520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892666.021522:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3621:x1876835055515136:12345-0@lo:103:ldlm_bl.0 Request processed in 556us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.021546:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00010000:00010000:0.0:1789892666.021549:0:216523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99600/0xd5b980e0d62af572 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 216523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.021572:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055515136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892666.155894:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892666.155979:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062740736 00000100:00100000:0.0:1789892666.155992:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062740736 00000100:00100000:0.0:1789892666.156094:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2180 00000100:00100000:0.0:1789892666.156109:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062740736:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892666.156127:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892666.156151:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603d7 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.156183:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.156198:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.156210:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99600, rc 0) 00000100:00100000:0.0:1789892666.156272:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062740736:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 167us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.156282:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2180 00000100:00100000:2.0:1789892666.157270:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892666.157315:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062740864 00000100:00100000:3.0:1789892666.157321:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062740864 00000100:00100000:3.0:1789892666.157351:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2181 00000100:00100000:3.0:1789892666.157358:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062740864:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.157472:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062740864:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 114us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.157479:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2181 00000100:00100000:3.0:1789892666.158447:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892666.158490:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062740992 00000100:00100000:1.0:1789892666.158496:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062740992 00000100:00100000:1.0:1789892666.158526:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2182 00000100:00100000:1.0:1789892666.158533:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062740992:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892666.158637:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062740992:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 101us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.158646:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2182 00000100:00100000:1.0:1789892666.159810:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892666.159865:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062741120 00000100:00100000:0.0:1789892666.159872:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062741120 00000100:00100000:0.0:1789892666.159913:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2183 00000100:00100000:0.0:1789892666.159924:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215460:x1876835062741120:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892666.160046:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215460:x1876835062741120:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 123us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.160064:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2183 00000100:00100000:2.0:1789892666.160889:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892666.160944:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062741248 00000100:00100000:0.0:1789892666.160950:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062741248 00000100:00100000:0.0:1789892666.160984:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2184 00000100:00100000:0.0:1789892666.160993:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215460:x1876835062741248:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892666.161085:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:215460:x1876835062741248:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.161095:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2184 00000100:00100000:3.0:1789892666.162011:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892666.162062:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062741376 00000100:00100000:2.0:1789892666.162068:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062741376 00000100:00100000:2.0:1789892666.162099:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2185 00000100:00100000:2.0:1789892666.162107:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062741376:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892666.162115:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892666.162131:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603de expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.162148:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 10 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.162156:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 10 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.162162:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382c00, rc 0) 00000100:00100000:2.0:1789892666.162194:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062741376:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 89us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.162200:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2185 00000100:00100000:1.0:1789892666.162860:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892666.162901:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062741504 00000100:00100000:3.0:1789892666.162906:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062741504 00000100:00100000:3.0:1789892666.162931:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2186 00000100:00100000:3.0:1789892666.162937:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062741504:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.162987:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062741504:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 49us (127us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892666.163001:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2186 10000000:01000000:2.0:1789892666.217762:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892666.217770:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 171 10000000:01000000:2.0:1789892666.217777:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892666.217824:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.217835:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.217846:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.217869:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055515648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.217929:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.217969:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.218019:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055515648 00000100:00100000:0.0:1789892666.218050:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055515648 00000100:00100000:0.0:1789892666.218121:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1789892666.218137:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055515648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892666.218154:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892666.218173:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af587 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.218206:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 16 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.218223:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 16 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.218237:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99400, rc 0) 00000100:00100000:0.0:1789892666.218306:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055515648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.218318:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:2.0:1789892666.218325:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055515648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892666.218359:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.218370:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.218429:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055515776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.218454:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.218472:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.218526:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055515776 00000100:00100000:0.0:1789892666.218534:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055515776 00000100:00100000:0.0:1789892666.218577:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:0.0:1789892666.218587:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055515776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.218780:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055515776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.218793:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:3.0:1789892666.218818:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055515776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.218867:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055515904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.218928:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.218965:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850bae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.218998:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055515904 00000100:00100000:2.0:1789892666.219005:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055515904 00000100:00100000:2.0:1789892666.219059:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:2.0:1789892666.219067:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055515904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.219161:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055515904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.219170:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1789892666.219197:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055515904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.219523:0:216524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216524:1876835055516032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892666.219579:0:216524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.219609:0:216524:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a256a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892666.219632:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055516032 00000100:00100000:3.0:1789892666.219638:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055516032 00000100:00100000:3.0:1789892666.219669:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:3.0:1789892666.219700:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216524:x1876835055516032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892666.219797:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216524:x1876835055516032:12345-0@lo:502:llog_process_th.0 Request processed in 121us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.219804:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00100000:0.0:1789892666.219858:0:216524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216524:1876835055516032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892666.219920:0:216524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216524:1876835055516160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892666.219968:0:216524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.220003:0:216524:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081d1dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892666.220018:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055516160 00000100:00100000:3.0:1789892666.220043:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055516160 00000100:00100000:3.0:1789892666.220083:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:3.0:1789892666.220095:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216524:x1876835055516160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892666.220194:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:216524:x1876835055516160:12345-0@lo:502:llog_process_th.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.220205:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00100000:0.0:1789892666.220252:0:216524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216524:1876835055516160:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892666.220284:0:216524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:3.0:1789892666.220373:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:3.0:1789892666.220411:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892666.220421:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.220451:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892666.220463:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892666.220465:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:3.0:1789892666.220469:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892666.220490:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.220501:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.220511:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.220531:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.220569:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.220595:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.220614:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055516288 00000100:00100000:0.0:1789892666.220622:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055516288 00000100:00100000:0.0:1789892666.220662:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1789892666.220673:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055516288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892666.220720:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892666.220734:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af595 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.220755:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.220784:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 17 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.220794:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98800, rc 0) 00000100:00100000:0.0:1789892666.220844:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055516288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.220856:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:3.0:1789892666.220861:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892666.220884:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.220897:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.220946:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.220973:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.221006:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.221059:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055516416 00000100:00100000:2.0:1789892666.221066:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055516416 00000100:00100000:2.0:1789892666.221102:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:2.0:1789892666.221112:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055516416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.221199:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055516416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.221207:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:3.0:1789892666.221215:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.221251:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.221286:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.221305:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892666.221361:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055516544 00000100:00100000:1.0:1789892666.221369:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055516544 00000100:00100000:1.0:1789892666.221405:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:1.0:1789892666.221422:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055516544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892666.221522:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055516544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.221530:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:3.0:1789892666.221564:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892666.222430:0:216525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:3.0:1789892666.222547:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:3.0:1789892666.222567:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789892666.222573:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.222583:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892666.222590:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892666.222592:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 171 10000000:01000000:3.0:1789892666.222594:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892666.222611:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.222618:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.222624:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.222637:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.222666:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.222743:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.222755:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055516672 00000100:00100000:0.0:1789892666.222764:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055516672 00000100:00100000:0.0:1789892666.222806:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:0.0:1789892666.222814:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055516672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892666.222825:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892666.222837:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af5a3 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.222858:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 18 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.222870:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 18 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.222880:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98000, rc 0) 00000100:00100000:0.0:1789892666.222927:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055516672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.222937:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:3.0:1789892666.222970:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892666.222983:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.222990:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.223049:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.223091:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.223110:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.223142:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055516800 00000100:00100000:0.0:1789892666.223149:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055516800 00000100:00100000:0.0:1789892666.223199:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:0.0:1789892666.223210:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055516800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.223311:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055516800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.223323:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:3.0:1789892666.223326:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.223359:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.223391:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.223407:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.223472:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055516928 00000100:00100000:2.0:1789892666.223479:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055516928 00000100:00100000:2.0:1789892666.223512:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:2.0:1789892666.223519:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055516928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.223608:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055516928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.223619:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:3.0:1789892666.223621:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055516928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.223865:0:216526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216526:1876835055517056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.223901:0:216526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.223928:0:216526:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892666.223935:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055517056 00000100:00100000:1.0:1789892666.223940:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055517056 00000100:00100000:1.0:1789892666.223969:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:1.0:1789892666.223975:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216526:x1876835055517056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892666.224069:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216526:x1876835055517056:12345-0@lo:502:llog_process_th.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.224076:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:2.0:1789892666.224108:0:216526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216526:1876835055517056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.224148:0:216526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216526:1876835055517184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.224180:0:216526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.224197:0:216526:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.224228:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055517184 00000100:00100000:0.0:1789892666.224236:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055517184 00000100:00100000:0.0:1789892666.224277:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1789892666.224291:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216526:x1876835055517184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892666.224399:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:216526:x1876835055517184:12345-0@lo:502:llog_process_th.0 Request processed in 111us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.224410:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:2.0:1789892666.224415:0:216526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216526:1876835055517184:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892666.224445:0:216526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:3.0:1789892666.224513:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:3.0:1789892666.224536:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892666.224541:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.224549:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892666.224555:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892666.224557:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:3.0:1789892666.224559:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892666.224578:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.224584:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.224591:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.224601:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.224625:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.224652:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.224700:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055517312 00000100:00100000:0.0:1789892666.224709:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055517312 00000100:00100000:0.0:1789892666.224754:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:0.0:1789892666.224768:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055517312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892666.224778:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892666.224789:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af5b1 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.224809:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.224822:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 19 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.224832:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98a00, rc 0) 00000100:00100000:0.0:1789892666.224878:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055517312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.224898:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:3.0:1789892666.224923:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892666.224939:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.224951:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.224995:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.225040:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.225090:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.225096:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055517440 00000100:00100000:2.0:1789892666.225101:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055517440 00000100:00100000:2.0:1789892666.225127:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:2.0:1789892666.225134:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055517440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.225200:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055517440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.225207:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:3.0:1789892666.225232:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.225255:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.225287:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.225303:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892666.225361:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055517568 00000100:00100000:1.0:1789892666.225367:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055517568 00000100:00100000:1.0:1789892666.225400:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:1.0:1789892666.225407:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055517568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892666.225487:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055517568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.225494:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00100000:3.0:1789892666.225503:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892666.226189:0:216527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:2.0:1789892666.226251:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:2.0:1789892666.226272:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892666.226278:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.226287:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892666.226300:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892666.226302:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 171 10000000:01000000:2.0:1789892666.226304:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892666.226317:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.226324:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.226330:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.226341:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.226364:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.226386:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.226411:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055517696 00000100:00100000:0.0:1789892666.226418:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055517696 00000100:00100000:0.0:1789892666.226455:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:0.0:1789892666.226467:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055517696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892666.226477:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892666.226489:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af5bf expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.226509:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 20 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.226521:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 20 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.226530:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98600, rc 0) 00000100:00100000:0.0:1789892666.226568:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055517696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.226575:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00100000:2.0:1789892666.226591:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892666.226607:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.226618:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.226663:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.226715:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.226743:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055517824 00000100:00100000:0.0:1789892666.226749:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055517824 00000100:00100000:2.0:1789892666.226752:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.226783:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:0.0:1789892666.226790:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055517824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.226854:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055517824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.226861:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:2.0:1789892666.226875:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.226907:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.226937:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.226955:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789892666.226972:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055517952 00000100:00100000:3.0:1789892666.226977:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055517952 00000100:00100000:3.0:1789892666.227004:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:3.0:1789892666.227011:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055517952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.227092:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055517952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.227098:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00100000:2.0:1789892666.227123:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055517952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.227313:0:216528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216528:1876835055518080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.227345:0:216528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.227361:0:216528:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789892666.227377:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055518080 00000100:00100000:1.0:1789892666.227383:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055518080 00000100:00100000:1.0:1789892666.227413:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:1.0:1789892666.227421:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216528:x1876835055518080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892666.227501:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216528:x1876835055518080:12345-0@lo:502:llog_process_th.0 Request processed in 79us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.227509:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00100000:2.0:1789892666.227516:0:216528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216528:1876835055518080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.227557:0:216528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216528:1876835055518208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.227587:0:216528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.227607:0:216528:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308206a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.227624:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055518208 00000100:00100000:0.0:1789892666.227639:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055518208 00000100:00100000:0.0:1789892666.227676:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:0.0:1789892666.227717:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216528:x1876835055518208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892666.227789:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:216528:x1876835055518208:12345-0@lo:502:llog_process_th.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.227796:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00000100:00100000:2.0:1789892666.227810:0:216528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216528:1876835055518208:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892666.227835:0:216528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:3.0:1789892666.227891:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:3.0:1789892666.227910:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892666.227916:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.227923:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892666.227930:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892666.227932:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 197 10000000:01000000:3.0:1789892666.227933:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892666.227947:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.227953:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.227959:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.227970:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055518336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.228000:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.228038:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850bac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.228042:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055518336 00000100:00100000:0.0:1789892666.228048:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055518336 00000100:00100000:0.0:1789892666.228074:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:0.0:1789892666.228079:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055518336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892666.228086:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892666.228093:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af5cd expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.228105:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.228112:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 21 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.228118:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892666.228148:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055518336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.228155:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00100000:3.0:1789892666.228171:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055518336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892666.228184:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.228191:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.228223:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055518464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.228245:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.228261:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.228280:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055518464 00000100:00100000:2.0:1789892666.228285:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055518464 00000100:00100000:2.0:1789892666.228313:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:2.0:1789892666.228319:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055518464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.228386:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055518464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.228393:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:3.0:1789892666.228402:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055518464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.228427:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055518592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.228459:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.228474:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892666.228488:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055518592 00000100:00100000:1.0:1789892666.228493:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055518592 00000100:00100000:1.0:1789892666.228520:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:1.0:1789892666.228526:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055518592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892666.228597:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055518592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.228604:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00100000:3.0:1789892666.228614:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055518592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.228820:0:216529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216529:1876835055518720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892666.228855:0:216529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.228886:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055518720 00000100:00100000:0.0:1789892666.228888:0:216529:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a256d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892666.228895:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055518720 00000100:00100000:3.0:1789892666.228930:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:3.0:1789892666.228936:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216529:x1876835055518720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892666.229018:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216529:x1876835055518720:12345-0@lo:502:llog_process_th.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.229038:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:0.0:1789892666.229049:0:216529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216529:1876835055518720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892666.229096:0:216529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892666.229105:0:216529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892666.229107:0:216529:0:(obd_config.c:1561:class_process_config()) marker 185 (0x1) lustre-MDT0001-m add lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:0.0:1789892666.229112:0:216529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1789892666.229127:0:216529:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool2 as member 1 00000100:00100000:0.0:1789892666.229142:0:216529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216529:1876835055518848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892666.229171:0:216529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.229189:0:216529:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a256d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.229204:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055518848 00000100:00100000:2.0:1789892666.229209:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055518848 00000100:00100000:2.0:1789892666.229235:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:2.0:1789892666.229240:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216529:x1876835055518848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.229312:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:216529:x1876835055518848:12345-0@lo:502:llog_process_th.0 Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.229320:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00100000:0.0:1789892666.229331:0:216529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216529:1876835055518848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892666.229353:0:216529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892666.229357:0:216529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892666.229358:0:216529:0:(obd_config.c:1561:class_process_config()) marker 185 (0x2) lustre-MDT0001-m add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789892666.229361:0:216529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 200 count 196 00000020:01000000:3.0:1789892666.229412:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 197-199 (rc=0) 10000000:01000000:3.0:1789892666.229435:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789892666.229440:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.229446:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892666.229452:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892666.229454:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 171 10000000:01000000:3.0:1789892666.229455:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892666.229467:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.229473:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.229478:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.229488:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055518976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.229510:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.229525:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.229541:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055518976 00000100:00100000:2.0:1789892666.229546:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055518976 00000100:00100000:2.0:1789892666.229568:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:2.0:1789892666.229574:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055518976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892666.229581:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892666.229588:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af5db expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.229606:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.229617:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.229626:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383600, rc 0) 00000100:00100000:2.0:1789892666.229671:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055518976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.229675:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055518976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.229705:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00010000:00010000:3.0:1789892666.229728:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.229735:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.229764:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.229789:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.229811:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892666.229820:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055519104 00000100:00100000:1.0:1789892666.229824:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055519104 00000100:00100000:1.0:1789892666.229852:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:1.0:1789892666.229856:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055519104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892666.229920:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055519104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.229927:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00100000:3.0:1789892666.229947:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.229972:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.230001:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.230016:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850bac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.230044:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055519232 00000100:00100000:0.0:1789892666.230049:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055519232 00000100:00100000:0.0:1789892666.230073:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:0.0:1789892666.230079:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055519232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.230141:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055519232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.230148:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:3.0:1789892666.230159:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.230345:0:216530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216530:1876835055519360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892666.230376:0:216530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.230391:0:216530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.230395:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055519360 00000100:00100000:2.0:1789892666.230401:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055519360 00000100:00100000:2.0:1789892666.230427:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:2.0:1789892666.230433:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216530:x1876835055519360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.230505:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216530:x1876835055519360:12345-0@lo:502:llog_process_th.0 Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.230520:0:216530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216530:1876835055519360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.230521:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00100000:3.0:1789892666.230562:0:216530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216530:1876835055519488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892666.230592:0:216530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.230605:0:216530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892666.230617:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055519488 00000100:00100000:2.0:1789892666.230622:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055519488 00000100:00100000:2.0:1789892666.230654:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:2.0:1789892666.230664:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216530:x1876835055519488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.230776:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:216530:x1876835055519488:12345-0@lo:502:llog_process_th.0 Request processed in 112us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.230778:0:216530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216530:1876835055519488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.230793:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000040:00080000:3.0:1789892666.230806:0:216530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:2.0:1789892666.230850:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:2.0:1789892666.230876:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892666.230881:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.230889:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892666.230895:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892666.230897:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 197 10000000:01000000:2.0:1789892666.230899:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892666.230911:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.230916:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.230922:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.230932:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.230960:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.230980:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892666.231045:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055519616 00000100:00100000:1.0:1789892666.231051:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055519616 00000100:00100000:1.0:1789892666.231080:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:1.0:1789892666.231087:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055519616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892666.231095:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892666.231103:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af5e9 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.231116:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.231124:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892666.231141:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6c00, rc 0) 00000100:00100000:1.0:1789892666.231176:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055519616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.231183:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:2.0:1789892666.231187:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892666.231205:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892666.231215:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892666.231261:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.231289:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.231310:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.231326:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055519744 00000100:00100000:0.0:1789892666.231331:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055519744 00000100:00100000:0.0:1789892666.231354:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:0.0:1789892666.231360:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055519744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.231435:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055519744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.231447:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.231463:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00100000:2.0:1789892666.231477:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.231511:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.231526:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.231542:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055519872 00000100:00100000:0.0:1789892666.231547:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055519872 00000100:00100000:0.0:1789892666.231569:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:0.0:1789892666.231574:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055519872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.231654:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055519872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.231663:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:2.0:1789892666.231732:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055519872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892666.231956:0:216531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216531:1876835055520000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892666.231986:0:216531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.232009:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055520000 00000100:00100000:2.0:1789892666.232013:0:216531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892666.232015:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055520000 00000100:00100000:3.0:1789892666.232073:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:3.0:1789892666.232079:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216531:x1876835055520000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892666.232152:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216531:x1876835055520000:12345-0@lo:502:llog_process_th.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.232159:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:2.0:1789892666.232169:0:216531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216531:1876835055520000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892666.232192:0:216531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892666.232199:0:216531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892666.232201:0:216531:0:(obd_config.c:1561:class_process_config()) marker 184 (0x1) lustre-MDT0000-m add lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:2.0:1789892666.232206:0:216531:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789892666.232218:0:216531:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool2 as member 1 00000020:01000004:2.0:1789892666.232521:0:216532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789892666.232525:0:216532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:1.0:1789892666.232535:0:216531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216531:1876835055520128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892666.232577:0:216531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892666.232598:0:216531:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092b89480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892666.232611:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055520128 00000100:00100000:3.0:1789892666.232616:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055520128 00000100:00100000:3.0:1789892666.232644:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:3.0:1789892666.232652:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216531:x1876835055520128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892666.232752:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:216531:x1876835055520128:12345-0@lo:502:llog_process_th.0 Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.232758:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000100:00100000:1.0:1789892666.232778:0:216531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:216531:1876835055520128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892666.232799:0:216531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892666.232804:0:216531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892666.232805:0:216531:0:(obd_config.c:1561:class_process_config()) marker 184 (0x2) lustre-MDT0000-m add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789892666.232808:0:216531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 200 count 196 00000020:01000000:3.0:1789892666.232878:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 197-199 (rc=0) 10000000:01000000:3.0:1789892666.232898:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892666.232904:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.232911:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892666.232916:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892666.232918:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:3.0:1789892666.232919:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892666.232931:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.232936:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.232942:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.232951:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055520256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.232971:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.232997:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.233053:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055520256 00000100:00100000:0.0:1789892666.233059:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055520256 00000100:00100000:0.0:1789892666.233097:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:0.0:1789892666.233104:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055520256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892666.233111:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892666.233118:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af5f7 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.233132:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.233139:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892666.233144:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99a00, rc 0) 00000100:00100000:0.0:1789892666.233177:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055520256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.233184:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1789892666.233187:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055520256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892666.233202:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.233208:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.233238:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055520384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892666.233257:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.233271:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030850ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892666.233287:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055520384 00000100:00100000:0.0:1789892666.233298:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055520384 00000100:00100000:0.0:1789892666.233322:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:0.0:1789892666.233328:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055520384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.233379:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055520384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892666.233385:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055520384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892666.233386:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 10000000:01000000:3.0:1789892666.233416:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892666.233420:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892666.233426:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892666.385885:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789892666.385923:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055520512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789892666.385992:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.386085:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055520512 00000100:00100000:2.0:1789892666.386094:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055520512 00000100:00100000:2.0:1789892666.386153:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789892666.386163:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055520512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789892666.386192:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789892666.386235:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055520512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.386243:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789892666.386297:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055520512:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789892666.449861:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892666.897846:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055520896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892666.897852:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055520768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892666.897870:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055521280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892666.897943:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.897943:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.897955:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055521408:0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.897990:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055520896 00000100:00100000:1.0:1789892666.897997:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055520896 00000100:00100000:0.0:1789892666.898002:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055521152:0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.898003:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055520640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892666.898017:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.898069:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.898078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.898082:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055521920:0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.898084:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789892666.898098:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055520896:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892666.898111:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055521664:0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.898116:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055521024:0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.898126:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789892666.898128:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892666.898158:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876835055522432:0@lo:400:kworker.0 00000100:00100000:0.0:1789892666.898166:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.898174:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892666.898180:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055520896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.898187:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789892666.898202:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892666.898207:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055522176:0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.898210:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055520640 00000100:00100000:1.0:1789892666.898214:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055520640 00000100:00100000:2.0:1789892666.898238:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055521536:0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.898241:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789892666.898243:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789892666.898252:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892666.898253:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055520640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892666.898258:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055521792:0@lo:400:kworker.0 00002000:00000024:1.0:1789892666.898275:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892666.898285:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876835055522688:0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.898303:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.898311:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892666.898317:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055520640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.898324:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789892666.898336:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892666.898346:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055522048:0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.898350:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055522304:0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.898362:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055520768 00000100:00100000:1.0:1789892666.898367:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055520768 00000100:00100000:1.0:1789892666.898394:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055521152 00000100:00100000:1.0:1789892666.898398:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055521152 00000100:00100000:0.0:1789892666.898399:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055520896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892666.898404:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.898405:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892666.898413:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055521792 00000100:00100000:1.0:1789892666.898416:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055521792 00000100:00100000:1.0:1789892666.898435:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789892666.898442:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055520768:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892666.898448:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876835055522560:0@lo:400:kworker.0 00000100:00100000:0.0:1789892666.898454:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055521664 00000100:00100000:3.0:1789892666.898460:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055521408 00000100:00100000:0.0:1789892666.898461:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055521664 00000004:00000024:1.0:1789892666.898463:0:190675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:3.0:1789892666.898467:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055521408 00000100:00100000:2.0:1789892666.898486:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892666.898515:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055520768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.898520:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055522432 00000100:00100000:3.0:1789892666.898523:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055521920 00000100:00100000:1.0:1789892666.898524:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789892666.898527:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055522432 00000100:00100000:3.0:1789892666.898530:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055521920 00000100:00100000:2.0:1789892666.898545:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055520768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892666.898546:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789892666.898555:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1789892666.898559:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055521152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.898565:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055521536 00000100:00100000:3.0:1789892666.898570:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055521536 00000100:00100000:0.0:1789892666.898573:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.898575:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055520640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892666.898595:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055522048 00000100:00100000:3.0:1789892666.898602:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055522048 00000100:00100000:1.0:1789892666.898602:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055521152:12345-0@lo:400:kworker.0 Request processed in 44us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.898613:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1789892666.898631:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892666.898635:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789892666.898637:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055521664:12345-0@lo:400:kworker.0 Request processed in 68us (470us total) trans 0 rc 0/0 00000100:00080000:2.0:1789892666.898640:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892666.898642:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00080000:2.0:1789892666.898646:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789892666.898651:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055521408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.898659:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.898675:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789892666.898675:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1789892666.898720:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055521920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892666.898724:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055522176 00000100:00100000:0.0:1789892666.898730:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055522176 00000100:00100000:3.0:1789892666.898745:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055521408:12345-0@lo:400:kworker.0 Request processed in 96us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.898745:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055521792:12345-0@lo:400:kworker.0 Request processed in 88us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.898751:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055522688 00000100:00100000:0.0:1789892666.898758:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055522688 00000100:00100000:1.0:1789892666.898763:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789892666.898767:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789892666.898775:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055521920:12345-0@lo:400:kworker.0 Request processed in 59us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.898786:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789892666.898794:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789892666.898798:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055522304 00000100:00100000:0.0:1789892666.898803:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055522304 00000100:00100000:1.0:1789892666.898807:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892666.898809:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055521536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.898817:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789892666.898830:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055522560 00000100:00100000:2.0:1789892666.898832:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055522048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892666.898835:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055522560 00000100:00100000:1.0:1789892666.898842:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055521280 00000100:00100000:1.0:1789892666.898847:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055521280 00000100:00100000:3.0:1789892666.898871:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055521536:12345-0@lo:400:kworker.0 Request processed in 64us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892666.898871:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1789892666.898881:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789892666.898889:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789892666.898890:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876835055522432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.898896:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055521280:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892666.898897:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055522048:12345-0@lo:400:kworker.0 Request processed in 65us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.898912:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00002000:00000024:1.0:1789892666.898919:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892666.898949:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876835055522432:12345-0@lo:400:kworker.0 Request processed in 67us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.898951:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1789892666.898960:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055521280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.898965:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789892666.898968:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876835055522176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.898976:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789892666.898981:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1789892666.898985:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876835055522688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892666.899010:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1789892666.899015:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055521280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892666.899039:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055522304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.899046:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876835055522176:12345-0@lo:400:kworker.0 Request processed in 80us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.899061:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1789892666.899062:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876835055522688:12345-0@lo:400:kworker.0 Request processed in 79us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892666.899074:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1789892666.899091:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1789892666.899092:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055522304:12345-0@lo:400:kworker.0 Request processed in 69us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.899104:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876835055522560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892666.899106:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1789892666.899133:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055521024 00000100:00080000:0.0:1789892666.899136:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892666.899138:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055521536:0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.899140:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055521024 00000100:00080000:0.0:1789892666.899144:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892666.899147:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876835055522560:12345-0@lo:400:kworker.0 Request processed in 45us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892666.899154:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1789892666.899168:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055522048:0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.899187:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1789892666.899189:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1876835055522560:0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.899203:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055521024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.899204:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055521664:0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.899223:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055522176:0@lo:400:kworker.0 00010000:00080000:1.0:1789892666.899238:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9031915d9500 x1876835055522688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892666.899247:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876835055522688:0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.899265:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055521792:0@lo:400:kworker.0 00000100:00100000:1.0:1789892666.899267:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055521152:0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.899273:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055521024:12345-0@lo:400:kworker.0 Request processed in 72us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892666.899284:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1789892666.899293:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055522304:0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.899319:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055521408:0@lo:400:kworker.0 00000100:00100000:2.0:1789892666.899332:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055521920:0@lo:400:kworker.0 00000100:00100000:3.0:1789892666.899350:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055521024:0@lo:400:kworker.0 00010000:00080000:2.0:1789892666.899353:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9031915d8e00 x1876835055522432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789892666.899366:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876835055522432:0@lo:400:kworker.0 00000100:00100000:0.0:1789892667.343967:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892667.344034:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062741632 00000100:00100000:2.0:1789892667.344046:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062741632 00000100:00080000:0.0:1789892667.344090:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892667.344114:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2795 00000100:00100000:2.0:1789892667.344126:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215480:x1876835062741632:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:2.0:1789892667.345149:0:192197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:192197:1876835055522816:0@lo:19:mdt00_003.0 00000100:00100000:2.0:1789892667.345199:0:192197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892667.345224:0:192197:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892667.345237:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055522816 00000100:00100000:1.0:1789892667.345244:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055522816 00000100:00100000:1.0:1789892667.345287:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789892667.345298:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ff23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:192197:x1876835055522816:12345-0@lo:19:mdt00_003.0 00000100:00100000:1.0:1789892667.345464:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ff23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:192197:x1876835055522816:12345-0@lo:19:mdt00_003.0 Request processed in 168us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892667.345473:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789892667.345488:0:192197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:192197:1876835055522816:0@lo:19:mdt00_003.0 00000100:00100000:2.0:1789892667.345563:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215480:x1876835062741632:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1438us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892667.345573:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2795 00000100:00100000:2.0:1789892667.346483:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892667.346562:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062741760 00000100:00100000:0.0:1789892667.346567:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062741760 00000100:00100000:0.0:1789892667.346604:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2796 00000100:00100000:0.0:1789892667.346612:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215480:x1876835062741760:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:0.0:1789892667.348301:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215480:x1876835062741760:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1688us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892667.348324:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2796 00010000:00010000:3.0:1789892667.473837:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789892668.184217:0:216681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3358438535438ns, next at 3261060696520ns, rc = 0 00080000:00080000:2.0:1789892668.184230:0:216681:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789892668.184324:0:216681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3358438643869ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789892668.184330:0:216681:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789892668.184405:0:216681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3358438725064ns, next at 3187969760152ns, rc = 0 00080000:00080000:2.0:1789892668.184410:0:216681:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789892668.184470:0:216681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3358438790209ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789892668.184481:0:216681:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789892668.185052:0:190650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 44 committed 00000004:00080000:1.0:1789892668.185225:0:191400:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 36 committed 00000004:00080000:0.0:1789892668.185477:0:190650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 42 committed 00000004:00080000:1.0:1789892668.185608:0:191400:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 36 committed 00000100:00100000:1.0:1789892668.434872:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055522944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789892668.434934:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892668.434991:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055522944 00000100:00100000:3.0:1789892668.435004:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055522944 00000100:00080000:0.0:1789892668.435073:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892668.435086:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789892668.435097:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055522944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789892668.435126:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892668.435201:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055522944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892668.435211:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789892668.435257:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055522944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789892668.497787:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892668.643982:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892668.644048:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062741888 00000100:00100000:2.0:1789892668.644060:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062741888 00000100:00100000:2.0:1789892668.644118:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2797 00000100:00100000:2.0:1789892668.644131:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215670:x1876835062741888:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:2.0:1789892668.644238:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215670:x1876835062741888:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 111us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892668.644250:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2797 00000100:00100000:2.0:1789892668.653100:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892668.653143:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062742016 00000100:00100000:1.0:1789892668.653149:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062742016 00000100:00100000:1.0:1789892668.653188:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2798 00000100:00100000:1.0:1789892668.653197:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215672:x1876835062742016:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:1.0:1789892668.653258:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:215672:x1876835062742016:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892668.653266:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2798 00000100:00100000:2.0:1789892669.115728:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892669.115767:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892669.115802:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892669.115817:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062742144 00000100:00100000:0.0:1789892669.115820:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062742272 00000100:00100000:1.0:1789892669.115831:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062742144 00000100:00100000:0.0:1789892669.115832:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062742272 00000100:00100000:2.0:1789892669.115838:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062742400 00000100:00100000:2.0:1789892669.115846:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062742400 00000100:00100000:1.0:1789892669.115921:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2226 00000100:00100000:0.0:1789892669.115921:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 487 00000100:00100000:2.0:1789892669.115936:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 488 00000100:00100000:1.0:1789892669.115948:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2395:x1876835062742144:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1789892669.115948:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2394:x1876835062742272:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1789892669.115962:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2395:x1876835062742400:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1789892669.116055:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2394:x1876835062742272:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892669.116056:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2395:x1876835062742144:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892669.116067:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2395:x1876835062742400:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 108us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892669.116085:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 487 00000100:00100000:1.0:1789892669.116095:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2226 00000100:00100000:2.0:1789892669.116103:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 488 00000100:00080000:0.0:1789892669.116124:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789892669.116130:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789892669.116990:0:216777:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_71b: @@@@@@ FAIL: Used space(10240) for user quota_usr isn't 0. 00010000:00010000:2.0:1789892669.521794:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 12602 lines, 12602 kept, 0 dropped, 0 bad.