00010000:00010000:3.0F:1717018875.698910:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018876.528381:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018876.528434:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0F:1717018876.528528:0:4621:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1717018876.528553:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819889856 00000100:00100000:0.0F:1717018876.528561:0:10301:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1717018876.528575:0:10301:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819889920 00000100:00100000:2.0:1717018876.528619:0:4621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77860 00000100:00100000:2.0:1717018876.528625:0:4621:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aaf07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+4:27068:x1800422819889856:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717018876.529230:0:4621:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1717018876.529230:0:10301:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2691 00000100:00100000:2.0:1717018876.529234:0:4621:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aaf07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+4:27068:x1800422819889856:12345-192.168.203.126@tcp:104: Request processed in 610us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018876.529234:0:10301:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:461e9689-0dac-4669-87c3-00abdddc539f+4:27068:x1800422819889920:12345-192.168.203.126@tcp:104: 00000100:00100000:2.0:1717018876.529241:0:4621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77860 00010000:00010000:0.0:1717018876.529257:0:10301:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1717018876.529260:0:10301:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:461e9689-0dac-4669-87c3-00abdddc539f+3:27068:x1800422819889920:12345-192.168.203.126@tcp:104: Request processed in 26us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018876.529264:0:10301:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2691 00010000:00010000:2.0:1717018876.529272:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1717018876.529276:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529285:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809dd40 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:2.0:1717018876.529287:0:10237:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529292:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018876.529296:0:10237:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018876.529300:0:10237:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018876.529324:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529329:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018876.529346:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529350:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529370:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1717018876.529371:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529375:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809df80 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:2.0:1717018876.529376:0:10237:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529380:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018876.529383:0:10237:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018876.529387:0:10237:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018876.529395:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529399:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018876.529402:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.529406:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.529410:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018876.529415:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018876.529416:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018876.529417:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018876.529434:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838667456:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1717018876.529547:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838667392:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1717018876.532174:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838667392:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1717018876.532650:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838667456:192.168.203.126@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018876.701052:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1717018877.704064:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717018877.868704:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018877.868710:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 98 10000000:01000000:2.0:1717018877.868715:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018877.868751:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.868759:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.868767:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.869345:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667520:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.869420:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.873703:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667520:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.873732:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.873743:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.873817:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667584:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.873883:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.876306:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667584:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.876353:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667648:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.876416:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.877927:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667648:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.878348:0:22715:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a250c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22715:1800422838667712:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717018877.878399:0:22715:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd480 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.880031:0:22715:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a250c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22715:1800422838667712:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:0.0:1717018877.880068:0:22715:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1717018877.880074:0:22715:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018877.880075:0:22715:0:(obd_config.c:1460:class_process_config()) marker 64 (0x1) lustre-clilov rem lustre.test_22c.lustre-OST0000_UUID 00000020:01000000:0.0:1717018877.880079:0:22715:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:0.0:1717018877.880081:0:22715:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1717018877.880091:0:22715:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from test_22c 00000100:00100000:0.0:1717018877.880117:0:22715:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22715:1800422838667776:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:0.0:1717018877.880175:0:22715:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0240 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.882433:0:22715:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22715:1800422838667776:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:0.0:1717018877.882471:0:22715:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1717018877.882477:0:22715:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018877.882478:0:22715:0:(obd_config.c:1460:class_process_config()) marker 64 (0x2) lustre-clilov rem lustre.test_22c.lustre-OST0000_UUID 00000040:00080000:0.0:1717018877.882482:0:22715:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 101 count 99 00000020:01000000:2.0:1717018877.882690:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 98-100 (rc=0) 10000000:01000000:2.0:1717018877.882711:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018877.882718:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.882729:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018877.882736:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717018877.882738:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:2.0:1717018877.882740:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717018877.882764:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.882770:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.882777:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.882794:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667840:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.883034:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.885396:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667840:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.885424:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.885434:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.885512:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667904:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.885555:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.887322:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838667904:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1717018877.887359:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1717018877.887366:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.887375:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018878.272996:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838668032:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018878.273067:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717018878.273072:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838667968:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018878.273090:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838668096:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018878.277377:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838667968:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018878.277392:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838668096:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018878.277400:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838668032:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1717018878.704910:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018878.853723:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018878.854140:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893440 00000100:00100000:2.0:1717018878.854149:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018878.854169:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893696 00000100:00100000:3.0:1717018878.854180:0:4621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77861 00000100:00100000:3.0:1717018878.854185:0:4621:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8973900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+4:27163:x1800422819893440:12345-192.168.203.126@tcp:104: 00000100:00100000:2.0:1717018878.854187:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77862 00000100:00100000:2.0:1717018878.854190:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8973dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+4:27163:x1800422819893696:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018878.854245:0:4621:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1717018878.854247:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018878.854250:0:4621:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8973900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+4:27163:x1800422819893440:12345-192.168.203.126@tcp:104: Request processed in 65us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018878.854250:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8973dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+4:27163:x1800422819893696:12345-192.168.203.126@tcp:104: Request processed in 59us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018878.854255:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77862 00000100:00100000:3.0:1717018878.854257:0:4621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77861 00010000:00010000:2.0:1717018878.854270:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1717018878.854275:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.854283:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809fa80 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:2.0:1717018878.854285:0:10237:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.854290:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018878.854295:0:10237:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018878.854299:0:10237:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018878.854324:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.854329:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018878.854340:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.854344:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a36762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17ba expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018878.854353:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838668160:192.168.203.126@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018878.854354:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1717018878.854355:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.854361:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d200 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:2.0:1717018878.854362:0:10237:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.854366:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018878.854370:0:10237:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018878.854373:0:10237:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018878.854383:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.854387:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018878.854392:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018878.854394:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838668224:192.168.203.126@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018878.854396:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809d200/0xe1aedd3f13a3675b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17b3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.854404:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.854405:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.854406:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018878.854452:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018878.856805:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838668224:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1717018878.857051:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838668160:192.168.203.126@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018879.706821:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1717018880.697724:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1717018880.697730:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 101 10000000:01000000:3.0:1717018880.697736:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1717018880.697780:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.697789:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.697813:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.697836:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a25a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668288:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1717018880.700498:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd0c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018880.704178:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a25a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668288:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018880.704208:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.704233:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018880.704312:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668352:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018880.704379:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0540 going to sleep for 6 seconds 00000100:00100000:0.0:1717018880.706158:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668352:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018880.706206:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668416:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018880.706305:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0540 going to sleep for 6 seconds 00000100:00100000:0.0:1717018880.707751:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668416:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018880.708342:0:22743:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22743:1800422838668480:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018880.708410:0:22743:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892fe40 going to sleep for 6 seconds 00010000:00010000:1.0:1717018880.708699:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018880.710830:0:22743:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22743:1800422838668480:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018880.710873:0:22743:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018880.710881:0:22743:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018880.710887:0:22743:0:(obd_config.c:1460:class_process_config()) marker 66 (0x1) lustre-clilov rem lustre.test_22c.lustre-OST0001_UUID 00000020:01000000:1.0:1717018880.710892:0:22743:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018880.710894:0:22743:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1717018880.710906:0:22743:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from test_22c 00000020:01000000:1.0:1717018880.710909:0:22743:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018880.710911:0:22743:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018880.710911:0:22743:0:(obd_config.c:1460:class_process_config()) marker 66 (0x2) lustre-clilov rem lustre.test_22c.lustre-OST0001_UUID 00000020:01000000:1.0:1717018880.710913:0:22743:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018880.710914:0:22743:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018880.710915:0:22743:0:(obd_config.c:1460:class_process_config()) marker 68 (0x1) lustre-clilov del lustre.test_22c 00000020:01000000:1.0:1717018880.710917:0:22743:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018880.710918:0:22743:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1717018880.710974:0:22743:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22743:1800422838668544:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018880.711031:0:22743:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717018880.712705:0:22743:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22743:1800422838668544:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018880.712738:0:22743:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018880.712743:0:22743:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018880.712745:0:22743:0:(obd_config.c:1460:class_process_config()) marker 68 (0x2) lustre-clilov del lustre.test_22c 00000040:00080000:1.0:1717018880.712748:0:22743:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 107 count 105 00000020:01000000:0.0:1717018880.712815:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 101-106 (rc=0) 10000000:01000000:0.0:1717018880.712836:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717018880.712843:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.712897:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018880.712907:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717018880.712909:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:0.0:1717018880.712910:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717018880.712935:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.712939:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.712944:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018880.712968:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668608:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018880.713028:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0540 going to sleep for 6 seconds 00000100:00100000:0.0:1717018880.714603:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668608:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018880.714627:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.714636:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018880.714710:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668672:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018880.714767:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0540 going to sleep for 6 seconds 00000100:00100000:0.0:1717018880.716614:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838668672:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717018880.716652:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717018880.716671:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.716680:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.711290:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018882.714062:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018883.280991:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838668800:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018883.281052:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838668928:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018883.281090:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018883.281094:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838668736:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018883.281794:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838668864:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018883.287371:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838668736:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018883.287392:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838668864:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018883.287401:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838668800:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018883.287408:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838668928:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018883.718313:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018884.720749:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1717018884.799990:0:23031:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717018884.799995:0:23031:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 22d: out of/low on space + failed to repeat + forced extension ========================================================== 17:41:24 (1717018884) 00000080:00200000:2.0:1717018884.861373:0:22895:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:2.0:1717018884.861390:0:22895:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1717018884.861403:0:22895:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.861414:0:22895:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1717018884.861422:0:22895:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:2.0:1717018884.861423:0:22895:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:2.0:1717018884.861428:0:22895:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8d5baf8 00010000:00010000:2.0:1717018884.861430:0:22895:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.861435:0:22895:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717018884.861451:0:22895:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:2.0:1717018884.861459:0:22895:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1 00000080:00200000:2.0:1717018884.861462:0:22895:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=getattr 00000002:00010000:2.0:1717018884.861468:0:22895:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22d.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1717018884.861502:0:22895:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.861507:0:22895:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.861514:0:22895:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018884.861534:0:22895:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:22895:1800422838668992:192.168.203.126@tcp:101:bash.0 00000100:00100000:2.0:1717018884.861991:0:22895:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a88800c0 going to sleep for 87 seconds 00000100:00100000:2.0:1717018884.864154:0:22895:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:22895:1800422838668992:192.168.203.126@tcp:101:bash.0 00010000:00010000:2.0:1717018884.864171:0:22895:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864183:0:22895:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864187:0:22895:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864192:0:22895:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864208:0:22895:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864213:0:22895:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d200 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:2.0:1717018884.864216:0:22895:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864221:0:22895:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864225:0:22895:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864229:0:22895:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1717018884.864232:0:22895:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864236:0:22895:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1717018884.864246:0:22895:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a8973440 x1800422838668992/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018973 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:2.0:1717018884.864269:0:22895:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:2.0:1717018884.864378:0:22895:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:2.0:1717018884.864386:0:22895:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1717018884.864390:0:22895:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:2.0:1717018884.864414:0:22895:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864425:0:22895:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.864431:0:22895:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018884.864444:0:22895:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:22895:1800422838669056:192.168.203.126@tcp:101:bash.0 00000100:00100000:2.0:1717018884.864489:0:22895:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a88800c0 going to sleep for 87 seconds 00000100:00100000:2.0:1717018884.866647:0:22895:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:22895:1800422838669056:192.168.203.126@tcp:101:bash.0 00010000:00010000:2.0:1717018884.866664:0:22895:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.866672:0:22895:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.866679:0:22895:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.866686:0:22895:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.866692:0:22895:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.866696:0:22895:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.866701:0:22895:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1717018884.866714:0:22895:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a8973440 x1800422838669056/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1717018973 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:2.0:1717018884.866722:0:22895:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.866729:0:22895:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1717018884.866748:0:22895:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 13824 00000080:00010000:2.0:1717018884.866752:0:22895:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a3677e 00000080:00010000:2.0:1717018884.866756:0:22895:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:2.0:1717018884.866758:0:22895:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a3677e from it ffff8800a8d5bcf8 00010000:00010000:2.0:1717018884.866759:0:22895:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018884.866764:0:22895:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018884.870349:0:23055:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018884.870363:0:23055:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018884.870376:0:23055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870387:0:23055:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018884.870395:0:23055:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018884.870397:0:23055:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018884.870402:0:23055:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8f57b58 00010000:00010000:3.0:1717018884.870404:0:23055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870409:0:23055:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018884.870420:0:23055:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:3.0:1717018884.870428:0:23055:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1536 00000080:00200000:3.0:1717018884.870430:0:23055:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018884.870433:0:23055:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018884.870436:0:23055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870446:0:23055:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018884.870452:0:23055:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018884.870454:0:23055:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018884.870456:0:23055:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8f57bf8 00010000:00010000:3.0:1717018884.870457:0:23055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870462:0:23055:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018884.870467:0:23055:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:3.0:1717018884.870470:0:23055:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018884.870473:0:23055:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018884.870476:0:23055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870481:0:23055:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018884.870486:0:23055:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018884.870488:0:23055:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018884.870489:0:23055:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8f57da0 00010000:00010000:3.0:1717018884.870490:0:23055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870495:0:23055:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018884.870510:0:23055:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:3.0:1717018884.870514:0:23055:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8) 00010000:00010000:3.0:1717018884.870530:0:23055:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870540:0:23055:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870574:0:23055:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018884.870608:0:23055:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018884.870610:0:23055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a3677e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c191f expref: -99 pid: 22895 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1717018884.870623:0:23055:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1717018884.870642:0:23055:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880136a263c0 x1800422838669184/t0(0) o36->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1717018884.870659:0:23055:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a263c0 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:23055:1800422838669184:192.168.203.126@tcp:36:mkdir.0 00000100:00100000:3.0:1717018884.870740:0:23055:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffdc00 going to sleep for 87 seconds 00000100:00100000:0.0:1717018884.875017:0:23055:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a263c0 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:23055:1800422838669184:192.168.203.126@tcp:36:mkdir.0 00000080:00200000:0.0:1717018884.875048:0:23055:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58) 00000080:00200000:0.0:1717018884.875052:0:23055:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cf0:0x0], updating i_size 512 00010000:00010000:1.0:1717018885.722892:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018886.724830:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018887.726870:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018888.289114:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838669312:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018888.289198:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838669440:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018888.289275:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838669248:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018888.289307:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838669376:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018888.295950:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838669312:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018888.295961:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838669440:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018888.296336:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838669248:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018888.296344:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838669376:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018888.729669:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018889.730797:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018890.732766:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018891.735966:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018892.736854:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018893.296784:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838669568:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018893.296816:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838669504:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018893.296859:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838669696:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018893.296859:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838669632:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018893.300338:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838669504:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018893.300986:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838669696:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018893.301785:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838669632:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018893.301848:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838669568:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018893.738927:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018894.740864:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018894.835887:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018894.835947:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018894.835976:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900608 00000100:00100000:3.0:1717018894.836003:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900672 00000100:00100000:3.0:1717018894.836012:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77863 00000100:00100000:3.0:1717018894.836017:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a26d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:28161:x1800422819900608:12345-192.168.203.126@tcp:104: 00000100:00100000:2.0:1717018894.836128:0:4622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77864 00010000:00010000:3.0:1717018894.836129:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717018894.836134:0:4622:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a276c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+4:28161:x1800422819900672:12345-192.168.203.126@tcp:104: 00000100:00100000:3.0:1717018894.836140:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a26d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:28161:x1800422819900608:12345-192.168.203.126@tcp:104: Request processed in 123us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.836146:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77863 00010000:00010000:2.0:1717018894.836171:0:4622:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1717018894.836175:0:4622:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a276c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+3:28161:x1800422819900672:12345-192.168.203.126@tcp:104: Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018894.836189:0:4622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77864 00010000:00010000:1.0:1717018894.836370:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1717018894.836375:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836384:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a893aac0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:1.0:1717018894.836387:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836393:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018894.836397:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018894.836406:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018894.836432:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836436:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018894.836449:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836453:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a893aac0/0xe1aedd3f13a36770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c189a expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836465:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717018894.836466:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836470:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a85c8d80 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:1.0:1717018894.836472:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836476:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018894.836480:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018894.836483:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018894.836491:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836495:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018894.836498:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836506:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a85c8d80/0xe1aedd3f13a36769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1893 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.836515:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018894.836516:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018894.836517:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018894.836531:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838669760:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1717018894.836577:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1717018894.836620:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838669824:192.168.203.126@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1717018894.836664:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018894.837999:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838669760:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1717018894.838344:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838669824:192.168.203.126@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1717018895.743071:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1717018895.910715:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1717018895.910722:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 107 10000000:01000000:1.0:1717018895.910726:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1717018895.910760:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018895.910768:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018895.910776:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018895.910794:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838669888:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717018895.911766:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f240 going to sleep for 6 seconds 00000100:00100000:1.0:1717018895.918158:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838669888:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018895.918187:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018895.918194:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018895.918244:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838669952:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018895.918295:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f240 going to sleep for 6 seconds 00000100:00100000:1.0:1717018895.922113:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838669952:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018895.922169:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670016:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018895.922249:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f240 going to sleep for 6 seconds 00000100:00100000:1.0:1717018895.924314:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670016:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018895.925666:0:23243:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:23243:1800422838670080:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018895.925738:0:23243:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f240 going to sleep for 6 seconds 00000100:00100000:1.0:1717018895.928189:0:23243:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:23243:1800422838670080:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018895.928257:0:23243:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018895.928265:0:23243:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018895.928266:0:23243:0:(obd_config.c:1460:class_process_config()) marker 70 (0x1) lustre-clilov new lustre.test_22d 00000020:01000000:1.0:1717018895.928271:0:23243:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018895.928274:0:23243:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1717018895.928293:0:23243:0:(lov_pool.c:313:lov_pool_new()) test_22d is pool #2 00000100:00100000:1.0:1717018895.928322:0:23243:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:23243:1800422838670144:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018895.928923:0:23243:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f6c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717018895.932477:0:23243:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:23243:1800422838670144:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018895.932524:0:23243:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018895.932530:0:23243:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018895.932532:0:23243:0:(obd_config.c:1460:class_process_config()) marker 70 (0x2) lustre-clilov new lustre.test_22d 00000040:00080000:1.0:1717018895.932535:0:23243:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 110 count 108 00000020:01000000:2.0:1717018895.932726:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 107-109 (rc=0) 10000000:01000000:2.0:1717018895.932747:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018895.932753:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018895.932762:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018895.932769:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717018895.932771:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:2.0:1717018895.932772:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717018895.932797:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018895.932803:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018895.932810:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018895.932829:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670208:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018895.932879:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880540 going to sleep for 6 seconds 00000100:00100000:2.0:1717018895.934424:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670208:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018895.934445:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018895.934453:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018895.934518:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670272:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018895.934568:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880540 going to sleep for 6 seconds 00000100:00100000:3.0:1717018895.936913:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670272:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1717018895.936955:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1717018895.936961:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018895.936970:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.744888:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018897.552016:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018897.552080:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018897.552114:0:18297:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903680 00000100:00100000:3.0:1717018897.552145:0:18297:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903744 00000100:00100000:3.0:1717018897.552155:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77865 00000100:00100000:3.0:1717018897.552161:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a25a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+4:28346:x1800422819903680:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018897.552223:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018897.552227:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a25a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+4:28346:x1800422819903680:12345-192.168.203.126@tcp:104: Request processed in 66us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.552233:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77865 00000100:00100000:3.0:1717018897.552246:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77866 00000100:00100000:3.0:1717018897.552249:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a250c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+3:28346:x1800422819903744:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018897.552281:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018897.552284:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a250c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+3:28346:x1800422819903744:12345-192.168.203.126@tcp:104: Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.552303:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77866 00010000:00010000:1.0:1717018897.552309:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1717018897.552315:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552324:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809fa80 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:1.0:1717018897.552326:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552331:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018897.552335:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018897.552339:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018897.552366:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552370:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018897.552381:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552386:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3678c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1942 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552397:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717018897.552398:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552411:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f206c0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:1.0:1717018897.552412:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.552412:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018897.552416:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018897.552419:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018897.552423:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018897.552443:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552448:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1717018897.552451:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838670336:192.168.203.126@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1717018897.552452:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552456:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f206c0/0xe1aedd3f13a36785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c193b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018897.552464:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018897.552465:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018897.552467:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018897.552513:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1717018897.552518:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838670400:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1717018897.554414:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838670400:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1717018897.554732:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838670336:192.168.203.126@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1717018897.746964:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018898.304868:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838670528:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1717018898.304956:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1717018898.304960:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838670464:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1717018898.304977:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838670592:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1717018898.306519:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838670464:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1717018898.306533:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838670592:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1717018898.306574:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838670528:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:2.0:1717018898.748808:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717018899.075319:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018899.075325:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 110 10000000:01000000:2.0:1717018899.075329:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018899.075362:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809f180/0xe1aedd3f13a36793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.075370:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809f180/0xe1aedd3f13a36793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.075378:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809f180/0xe1aedd3f13a36793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018899.075396:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670656:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018899.075469:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880d80 going to sleep for 6 seconds 00000100:00100000:2.0:1717018899.077233:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670656:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018899.077253:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809f180/0xe1aedd3f13a36793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a14 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.077262:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809f180/0xe1aedd3f13a36793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1a14 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018899.077312:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670720:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018899.077381:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880d80 going to sleep for 6 seconds 00000100:00100000:2.0:1717018899.079856:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670720:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018899.079918:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670784:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018899.079989:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880d80 going to sleep for 6 seconds 00000100:00100000:2.0:1717018899.081824:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670784:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018899.082397:0:23309:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a217c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:23309:1800422838670848:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717018899.082463:0:23309:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd240 going to sleep for 6 seconds 00000100:00100000:0.0:1717018899.083975:0:23309:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a217c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:23309:1800422838670848:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:0.0:1717018899.084015:0:23309:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1717018899.084023:0:23309:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018899.084025:0:23309:0:(obd_config.c:1460:class_process_config()) marker 72 (0x1) lustre-clilov add lustre.test_22d.lustre-OST0000_UUID 00000020:01000000:0.0:1717018899.084029:0:23309:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:0.0:1717018899.084031:0:23309:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1717018899.084042:0:23309:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_22d as member 1 00000100:00100000:0.0:1717018899.084068:0:23309:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:23309:1800422838670912:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:0.0:1717018899.084123:0:23309:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018899.085965:0:23309:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:23309:1800422838670912:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:0.0:1717018899.086002:0:23309:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1717018899.086008:0:23309:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018899.086009:0:23309:0:(obd_config.c:1460:class_process_config()) marker 72 (0x2) lustre-clilov add lustre.test_22d.lustre-OST0000_UUID 00000040:00080000:0.0:1717018899.086013:0:23309:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 113 count 111 00000020:01000000:2.0:1717018899.086196:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 110-112 (rc=0) 10000000:01000000:2.0:1717018899.086217:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018899.086223:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809f180/0xe1aedd3f13a36793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a14 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.086234:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809f180/0xe1aedd3f13a36793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a14 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018899.086243:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717018899.086245:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:2.0:1717018899.086247:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717018899.086272:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a3679a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.086278:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a3679a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.086286:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a3679a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018899.086303:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670976:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018899.086360:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880d80 going to sleep for 6 seconds 00000100:00100000:2.0:1717018899.088117:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838670976:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018899.088139:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a3679a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a1b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.088149:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a3679a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1a1b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018899.088208:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838671040:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018899.088252:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880d80 going to sleep for 6 seconds 00000100:00100000:2.0:1717018899.089923:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838671040:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1717018899.089955:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1717018899.089960:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a3679a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a1b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.089966:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a3679a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a1b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.750946:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1717018899.951932:0:23320:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018899.951954:0:23320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018899.951968:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.951980:0:23320:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018899.951994:0:23320:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018899.951997:0:23320:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018899.952003:0:23320:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff88009c3b3af8 00010000:00010000:1.0:1717018899.952006:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.952011:0:23320:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018899.952024:0:23320:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018899.952031:0:23320:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=16 00000080:00200000:1.0:1717018899.952035:0:23320:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=0 00000002:00010000:1.0:1717018899.952041:0:23320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22d.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018899.952081:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.952086:0:23320:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.952094:0:23320:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018899.952116:0:23320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671104:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018899.952198:0:23320:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f9c0 going to sleep for 80 seconds 00000100:00100000:1.0:1717018899.956293:0:23320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671104:192.168.203.126@tcp:101:lfs.0 00010000:00010000:1.0:1717018899.956318:0:23320:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956345:0:23320:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956351:0:23320:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956359:0:23320:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956367:0:23320:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956376:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956382:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956388:0:23320:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018899.956396:0:23320:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a93e0980 x1800422838671104/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018980 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1717018899.956406:0:23320:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956414:0:23320:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589935617/11504 (0 0) 00000080:00200000:1.0:1717018899.956439:0:23320:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cf0:0x0], updating i_size 11776 00000080:00200000:1.0:1717018899.956446:0:23320:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x2cf0:0x0](ffff8800b0a32f58): rc = 0 00000080:00010000:1.0:1717018899.956452:0:23320:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cf0:0x0](ffff8800b0a32f58) for lock 0xe1aedd3f13a367a1 00000080:00010000:1.0:1717018899.956463:0:23320:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x2cf0:0x0](ffff8800b0a32f58) 00000080:00010000:1.0:1717018899.956466:0:23320:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a367a1 from it ffff88009c3b3a70 00010000:00010000:1.0:1717018899.956468:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956474:0:23320:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018899.956500:0:23320:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58), inode mode 41ed mask 1 00000080:00200000:1.0:1717018899.956510:0:23320:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58), flags=0 00000080:00200000:1.0:1717018899.956513:0:23320:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58), intent=getattr 00000002:00010000:1.0:1717018899.956535:0:23320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22d.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x2cf0:0x0], intent: getattr flags 0 00010000:00010000:1.0:1717018899.956568:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956573:0:23320:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.956604:0:23320:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018899.956623:0:23320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671168:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018899.956743:0:23320:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f9c0 going to sleep for 80 seconds 00000100:00100000:1.0:1717018899.958261:0:23320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671168:192.168.203.126@tcp:101:lfs.0 00010000:00010000:1.0:1717018899.958273:0:23320:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958293:0:23320:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958298:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958303:0:23320:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958309:0:23320:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958314:0:23320:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f20fc0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:1.0:1717018899.958318:0:23320:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958323:0:23320:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958329:0:23320:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958334:0:23320:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1717018899.958338:0:23320:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958342:0:23320:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a367a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018899.958362:0:23320:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a93e0980 x1800422838671168/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018980 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:1.0:1717018899.958382:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958390:0:23320:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018899.958396:0:23320:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a367a1 from it ffff88009c3b39f0 00010000:00010000:1.0:1717018899.958398:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958403:0:23320:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018899.958474:0:23320:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018899.958482:0:23320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018899.958487:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958493:0:23320:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018899.958499:0:23320:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018899.958501:0:23320:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018899.958505:0:23320:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff88009c3b3bb0 00010000:00010000:1.0:1717018899.958506:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958514:0:23320:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018899.958521:0:23320:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018899.958539:0:23320:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d22d.sanity-pfl, flags=17 00000080:00200000:1.0:1717018899.958541:0:23320:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58), inode mode 41ed mask 1 00000080:00200000:1.0:1717018899.958547:0:23320:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f22d.sanity-pfl, flags=769 00000080:00200000:1.0:1717018899.958550:0:23320:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58), inode mode 41ed mask 3 00000080:00200000:1.0:1717018899.958553:0:23320:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58), file ffff8800b00b0000, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1717018899.958559:0:23320:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58), intent=open|creat 00000002:00010000:1.0:1717018899.958571:0:23320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22d.sanity-pfl,[0x200000401:0x2cf1:0x0]) in obj [0x200000401:0x2cf0:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1717018899.958578:0:23320:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958639:0:23320:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958645:0:23320:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018899.958646:0:23320:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a367a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1a37 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958666:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.958671:0:23320:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1717018899.958680:0:23320:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1717018899.958688:0:23320:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a93e0980 x1800422838671296/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1717018899.958694:0:23320:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018899.958709:0:23320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671296:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018899.958818:0:23320:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f9c0 going to sleep for 80 seconds 00000100:00100000:0.0:1717018899.962369:0:23320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e0980 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671296:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717018899.962394:0:23320:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 4/0,1 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962414:0:23320:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962433:0:23320:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962441:0:23320:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962449:0:23320:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962459:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962470:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962475:0:23320:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018899.962484:0:23320:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a93e0980 x1800422838671296/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018980 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1717018899.962494:0:23320:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a93e0980 x1800422838671296/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018980 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1717018899.962503:0:23320:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962510:0:23320:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 16 res 8589935617/11505 (0 0) 00000080:00200000:0.0:1717018899.962543:0:23320:0:(namei.c:1405:ll_create_it()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x2cf0:0x0](ffff8800b0a32f58), intent=open|creat 00000080:00200000:0.0:1717018899.962570:0:23320:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cf1:0x0](ffff8800b0ade598) 00000080:00200000:0.0:1717018899.962575:0:23320:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cf1:0x0], updating i_size 0 00000080:00200000:0.0:1717018899.962628:0:23320:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x2cf1:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1717018899.962634:0:23320:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x2cf1:0x0](ffff8800b0ade598) 00000080:00010000:0.0:1717018899.962636:0:23320:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cf1:0x0](ffff8800b0ade598) for lock 0xe1aedd3f13a367af 00000080:00200000:0.0:1717018899.962650:0:23320:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x2cf1:0x0](ffff8800b0ade598), flags 120501 00000002:00100000:0.0:1717018899.962662:0:23320:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a93e0980 x1800422838671296/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018980 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:0.0:1717018899.962752:0:23320:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a367af from it ffff8800b00bcb40 00010000:00010000:0.0:1717018899.962755:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962762:0:23320:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018899.962776:0:23320:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf1:0x0](ffff8800b0ade598), inode mode 81a4 mask 40 00000080:00200000:0.0:1717018899.962860:0:23320:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf1:0x0](ffff8800b0ade598), inode mode 81a4 mask 2 00000080:00200000:0.0:1717018899.962868:0:23320:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x2cf1:0x0](ffff8800b0ade598), xattr lov 00000002:00010000:0.0:1717018899.962881:0:23320:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x2cf1:0x0]) in obj [0x200000401:0x2cf0:0x0], intent: open flags 040000002 00010000:00010000:0.0:1717018899.962929:0:23320:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.962935:0:23320:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1717018899.962943:0:23320:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1717018899.962947:0:23320:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa60000 x1800422838671424/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1717018899.962961:0:23320:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018899.962978:0:23320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671424:192.168.203.126@tcp:101:lfs.0 00000100:00100000:0.0:1717018899.963049:0:23320:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 80 seconds 00000100:00100000:2.0:1717018899.964133:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018899.964230:0:4622:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1717018899.964246:0:4622:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819906048 00000100:00100000:3.0:1717018899.964288:0:4622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77867 00000100:00100000:3.0:1717018899.964291:0:4622:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b433c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:12cff408-c572-49fa-81b0-09052c8e7f41+5:8254:x1800422819906048:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018899.964329:0:4622:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018899.964333:0:4622:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b433c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:12cff408-c572-49fa-81b0-09052c8e7f41+5:8254:x1800422819906048:12345-192.168.203.126@tcp:104: Request processed in 42us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018899.964339:0:4622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77867 00010000:00010000:0.0:1717018899.964387:0:4630:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018899.964392:0:4630:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.964402:0:4630:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f21b00 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018899.964406:0:4630:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.964411:0:4630:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.964417:0:4630:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018899.964436:0:4630:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x2cf1:0x0]: losing layout lock 00010000:00010000:0.0:1717018899.964462:0:4630:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.964473:0:4630:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018899.964498:0:4630:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.964503:0:4630:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a367af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1a68 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.964540:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018899.964541:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018899.964542:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018899.964559:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1717018899.964570:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838671488:192.168.203.126@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1717018899.965949:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838671488:192.168.203.126@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1717018899.965988:0:23320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671424:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717018899.965999:0:23320:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966009:0:23320:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966014:0:23320:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966020:0:23320:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966026:0:23320:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966031:0:23320:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8938d80 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018899.966033:0:23320:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966051:0:23320:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966056:0:23320:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966061:0:23320:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717018899.966065:0:23320:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018899.966069:0:23320:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a367b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 23320 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018899.966086:0:23320:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff88012fa60000 x1800422838671424/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/600 e 0 to 0 dl 1717018980 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1717018899.966101:0:23320:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1717018899.966210:0:23320:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x2cf1:0x0](ffff8800b0ade598) 00000002:00100000:0.0:1717018899.966237:0:23320:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a93e0980 x1800422838671296/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018980 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1717018899.966254:0:23320:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1717018899.966257:0:23320:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa60000 x1800422838671616/t0(0) o35->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1717018899.966270:0:23320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671616:192.168.203.126@tcp:35:lfs.0 00000100:00100000:0.0:1717018899.966322:0:23320:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018899.969092:0:23320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:23320:1800422838671616:192.168.203.126@tcp:35:lfs.0 00000002:00100000:0.0:1717018899.969121:0:23320:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a93e0980 x1800422838671296/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018980 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000400:00000080:3.0:1717018900.545857:0:23452:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1717018900.545930:0:23452:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_22d: @@@@@@ FAIL: Create /mnt/lustre/d22d.sanity-pfl/f22d.sanity-pfl failed 00010000:00010000:1.0:1717018900.753014:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 751 lines, 751 kept, 0 dropped, 0 bad.