00010000:00010000:3.0F:1717018608.081177:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1717018609.095466:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018610.096769:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1717018611.101992:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018611.111053:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018611.111122:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819843648 00000100:00100000:3.0:1717018611.111168:0:4621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77836 00000100:00100000:3.0:1717018611.111173:0:4621:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8974c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+3:19967:x1800422819843648:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018611.111235:0:4621:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018611.111239:0:4621:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8974c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+3:19967:x1800422819843648:12345-192.168.203.126@tcp:104: Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018611.111245:0:4621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77836 00010000:00010000:0.0F:1717018611.112083:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018611.112094:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a365a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c0efa expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018611.112101:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f22d00 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018611.112104:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a365a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c0efa expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018611.112109:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a365a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c0efa expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018611.112114:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a365a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c0efa expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018611.112117:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018611.112156:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a365a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0efa expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018611.112161:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018611.112174:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a365a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0efa expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018611.112178:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a365a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0efa expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018611.112181:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838641792:192.168.203.126@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1717018611.112198:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018611.112199:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018611.112200:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018611.112272:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018611.112337:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819843712 00000100:00100000:2.0:1717018611.112352:0:4621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77837 00000100:00100000:2.0:1717018611.112355:0:4621:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8970e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+3:19967:x1800422819843712:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717018611.112377:0:4621:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717018611.112381:0:4621:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8970e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+3:19967:x1800422819843712:12345-192.168.203.126@tcp:104: Request processed in 26us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018611.112384:0:4621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77837 00010000:00010000:2.0:1717018611.112420:0:4630:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1717018611.112423:0:4630:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a3659b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c0ef3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018611.112428:0:4630:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f22ac0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:2.0:1717018611.112430:0:4630:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a3659b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c0ef3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018611.112434:0:4630:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a3659b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c0ef3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018611.112438:0:4630:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a3659b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c0ef3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018611.112442:0:4630:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018611.114024:0:4630:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a3659b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0ef3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018611.114033:0:4630:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018611.114044:0:4630:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a3659b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0ef3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018611.114055:0:4630:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a3659b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0ef3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018611.114124:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8971c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838641856:192.168.203.126@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1717018611.117897:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018611.117900:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018611.117903:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018611.118863:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8971c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838641856:192.168.203.126@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1717018611.119028:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838641792:192.168.203.126@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1717018612.106481:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1717018612.422319:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1717018612.422325:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 70 10000000:01000000:1.0:1717018612.422330:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1717018612.422366:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018612.422375:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018612.422384:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018612.422404:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838641920:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717018612.424525:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a93879c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717018612.428236:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838641920:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018612.428263:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018612.428273:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018612.428337:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838641984:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018612.430327:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a93879c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717018612.437762:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838641984:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018612.437815:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642048:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018612.437906:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a93879c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717018612.445189:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642048:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018612.445791:0:17134:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a24280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17134:1800422838642112:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717018612.446377:0:17134:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd540 going to sleep for 6 seconds 00000100:00100000:3.0:1717018612.451278:0:17134:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a24280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17134:1800422838642112:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:3.0:1717018612.451318:0:17134:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1717018612.451325:0:17134:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717018612.451327:0:17134:0:(obd_config.c:1460:class_process_config()) marker 46 (0x1) lustre-clilov rem lustre.test_20d.lustre-OST0000_UUID 00000020:01000000:3.0:1717018612.451331:0:17134:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:3.0:1717018612.451333:0:17134:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1717018612.451341:0:17134:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from test_20d 00000100:00100000:3.0:1717018612.451368:0:17134:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a24280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17134:1800422838642176:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717018612.451435:0:17134:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd540 going to sleep for 6 seconds 00000100:00100000:3.0:1717018612.453533:0:17134:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a24280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17134:1800422838642176:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:3.0:1717018612.453564:0:17134:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1717018612.453569:0:17134:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717018612.453570:0:17134:0:(obd_config.c:1460:class_process_config()) marker 46 (0x2) lustre-clilov rem lustre.test_20d.lustre-OST0000_UUID 00000040:00080000:3.0:1717018612.453573:0:17134:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 73 count 72 00000020:01000000:1.0:1717018612.454027:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 70-72 (rc=0) 10000000:01000000:1.0:1717018612.454044:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1717018612.454049:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018612.454058:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018612.454065:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1717018612.454067:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:1.0:1717018612.454069:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1717018612.454090:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018612.454095:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018612.454101:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018612.454115:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642240:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717018612.454171:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a93879c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717018612.455999:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642240:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018612.456020:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018612.456028:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018612.456083:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642304:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018612.458931:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a93879c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018612.463677:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642304:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717018612.463717:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717018612.463723:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018612.463744:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018612.850096:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838642432:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018612.850164:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717018612.850168:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8971c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838642368:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018612.850181:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838642496:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018612.855989:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8971c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838642368:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018612.856001:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838642496:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018612.856009:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838642432:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018613.110689:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018614.066136:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018614.066902:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018614.066934:0:4621:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1717018614.066952:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819846528 00000100:00100000:2.0:1717018614.066981:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819846720 00000100:00100000:2.0:1717018614.067011:0:4621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77838 00000100:00100000:2.0:1717018614.067015:0:4621:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8972140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+4:20129:x1800422819846528:12345-192.168.203.126@tcp:104: 00000100:00100000:3.0:1717018614.067061:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77839 00000100:00100000:3.0:1717018614.067067:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aaf06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:20129:x1800422819846720:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717018614.067089:0:4621:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717018614.067094:0:4621:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8972140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+4:20129:x1800422819846528:12345-192.168.203.126@tcp:104: Request processed in 79us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018614.067100:0:4621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77838 00010000:00010000:3.0:1717018614.067109:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018614.067114:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aaf06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+3:20129:x1800422819846720:12345-192.168.203.126@tcp:104: Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018614.067119:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77839 00010000:00010000:1.0:1717018614.067140:0:4629:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1717018614.067146:0:4629:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018614.067156:0:4629:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f22ac0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:1.0:1717018614.067159:0:4629:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018614.067169:0:4629:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018614.067174:0:4629:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018614.067179:0:4629:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018614.067210:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717018614.067212:0:4629:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.067214:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018614.067216:0:4629:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018614.067221:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f23840 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018614.067222:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.067227:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018614.067231:0:4629:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018614.067231:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018614.067235:0:4629:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0fd3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018614.067235:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018614.067248:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.067253:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018614.067257:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018614.067259:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018614.067260:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018614.067261:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f23840/0xe1aedd3f13a365c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c0fcc expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018614.067262:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018614.067276:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018614.067277:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018614.067278:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018614.067285:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838642560:192.168.203.126@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1717018614.067305:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838642624:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1717018614.070693:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838642560:192.168.203.126@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1717018614.070759:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838642624:192.168.203.126@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1717018614.113652:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1717018614.297903:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1717018614.297912:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 73 10000000:01000000:0.0:1717018614.297918:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1717018614.297961:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.297971:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.297980:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018614.298006:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642688:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018614.298094:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018614.301071:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642688:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018614.301098:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.301109:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018614.301180:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642752:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018614.301227:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018614.302978:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642752:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018614.303019:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642816:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018614.303071:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018614.304883:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838642816:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018614.305647:0:17154:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17154:1800422838642880:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018614.305707:0:17154:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387540 going to sleep for 6 seconds 00000100:00100000:1.0:1717018614.307744:0:17154:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17154:1800422838642880:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018614.307780:0:17154:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018614.307788:0:17154:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018614.307790:0:17154:0:(obd_config.c:1460:class_process_config()) marker 48 (0x1) lustre-clilov del lustre.test_20d 00000020:01000000:1.0:1717018614.307795:0:17154:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018614.307797:0:17154:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1717018614.307860:0:17154:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17154:1800422838642944:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018614.307904:0:17154:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387540 going to sleep for 6 seconds 00000100:00100000:1.0:1717018614.310572:0:17154:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17154:1800422838642944:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018614.310637:0:17154:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018614.310643:0:17154:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018614.310645:0:17154:0:(obd_config.c:1460:class_process_config()) marker 48 (0x2) lustre-clilov del lustre.test_20d 00000040:00080000:1.0:1717018614.310649:0:17154:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 76 count 75 00000020:01000000:0.0:1717018614.310904:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 73-75 (rc=0) 10000000:01000000:0.0:1717018614.310924:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717018614.310932:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.310942:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018614.310950:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717018614.310952:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:0.0:1717018614.310954:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717018614.310981:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.310987:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.310995:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018614.311012:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838643008:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018614.311058:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018614.314220:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838643008:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018614.314245:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.314256:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018614.314336:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838643072:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018614.314570:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018614.316956:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838643072:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717018614.316998:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717018614.317005:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018614.317014:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018615.124529:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018616.117226:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018617.118917:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018617.856821:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643200:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018617.856822:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838643136:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018617.856896:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643328:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018617.856898:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838643264:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018617.860470:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643200:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018617.860827:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838643136:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018617.860838:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838643264:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018617.861040:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643328:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717018618.120732:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1717018619.118918:0:17443:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1717018619.118922:0:17443:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 20e: ENOSPC with next real comp: spillover and backward extension ========================================================== 17:36:58 (1717018618) 00010000:00010000:2.0:1717018619.122986:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1717018619.206073:0:17306:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018619.206097:0:17306:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018619.206111:0:17306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.206124:0:17306:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018619.206135:0:17306:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018619.206141:0:17306:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018619.206148:0:17306:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8403af8 00010000:00010000:3.0:1717018619.206151:0:17306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.206156:0:17306:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018619.206169:0:17306:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:3.0:1717018619.206177:0:17306:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1 00000080:00200000:3.0:1717018619.206181:0:17306:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=getattr 00000002:00010000:3.0:1717018619.206188:0:17306:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d20e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1717018619.206222:0:17306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.206227:0:17306:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.206233:0:17306:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018619.206252:0:17306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23900 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:17306:1800422838643392:192.168.203.126@tcp:101:bash.0 00000100:00100000:3.0:1717018619.206316:0:17306:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd900 going to sleep for 87 seconds 00000100:00100000:3.0:1717018619.208835:0:17306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23900 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:17306:1800422838643392:192.168.203.126@tcp:101:bash.0 00010000:00010000:3.0:1717018619.208857:0:17306:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208869:0:17306:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208883:0:17306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208889:0:17306:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208895:0:17306:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208901:0:17306:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a85c9200 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:3.0:1717018619.208905:0:17306:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208910:0:17306:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208916:0:17306:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208921:0:17306:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1717018619.208925:0:17306:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.208930:0:17306:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9200/0xe1aedd3f13a365e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1717018619.208945:0:17306:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff880136a23900 x1800422838643392/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018708 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:3.0:1717018619.208975:0:17306:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:3.0:1717018619.209124:0:17306:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018619.209134:0:17306:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1717018619.209139:0:17306:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:3.0:1717018619.209171:0:17306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.209177:0:17306:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.209185:0:17306:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018619.209204:0:17306:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23900 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:17306:1800422838643456:192.168.203.126@tcp:101:bash.0 00000100:00100000:3.0:1717018619.209266:0:17306:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd900 going to sleep for 87 seconds 00000100:00100000:3.0:1717018619.210974:0:17306:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23900 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:17306:1800422838643456:192.168.203.126@tcp:101:bash.0 00010000:00010000:3.0:1717018619.210992:0:17306:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.211002:0:17306:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.211010:0:17306:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.211018:0:17306:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.211026:0:17306:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.211042:0:17306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.211047:0:17306:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1717018619.211054:0:17306:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff880136a23900 x1800422838643456/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1717018708 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:3.0:1717018619.211062:0:17306:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.211069:0:17306:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1717018619.211092:0:17306:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 13824 00000080:00010000:3.0:1717018619.211097:0:17306:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a365e8 00000080:00010000:3.0:1717018619.211101:0:17306:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018619.211103:0:17306:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a365e8 from it ffff8800a8403cf8 00010000:00010000:3.0:1717018619.211105:0:17306:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.211109:0:17306:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018619.214607:0:17467:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018619.214627:0:17467:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018619.214640:0:17467:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214660:0:17467:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018619.214669:0:17467:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018619.214671:0:17467:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018619.214677:0:17467:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a83c7b58 00010000:00010000:3.0:1717018619.214680:0:17467:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214684:0:17467:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018619.214695:0:17467:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:3.0:1717018619.214704:0:17467:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1536 00000080:00200000:3.0:1717018619.214707:0:17467:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018619.214709:0:17467:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018619.214712:0:17467:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214715:0:17467:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018619.214720:0:17467:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018619.214720:0:17467:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018619.214722:0:17467:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a83c7bf8 00010000:00010000:3.0:1717018619.214723:0:17467:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214733:0:17467:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018619.214739:0:17467:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:3.0:1717018619.214742:0:17467:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018619.214744:0:17467:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018619.214746:0:17467:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214750:0:17467:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018619.214754:0:17467:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018619.214755:0:17467:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018619.214756:0:17467:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a83c7da0 00010000:00010000:3.0:1717018619.214783:0:17467:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214788:0:17467:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018619.214792:0:17467:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:3.0:1717018619.214795:0:17467:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8) 00010000:00010000:3.0:1717018619.214814:0:17467:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214824:0:17467:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214868:0:17467:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018619.214872:0:17467:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018619.214873:0:17467:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cbcc0/0xe1aedd3f13a365e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c10cf expref: -99 pid: 17306 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1717018619.214886:0:17467:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1717018619.214895:0:17467:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880136a23900 x1800422838643584/t0(0) o36->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1717018619.214915:0:17467:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23900 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:17467:1800422838643584:192.168.203.126@tcp:36:mkdir.0 00000100:00100000:3.0:1717018619.218213:0:17467:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd900 going to sleep for 87 seconds 00000100:00100000:3.0:1717018619.221956:0:17467:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23900 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:17467:1800422838643584:192.168.203.126@tcp:36:mkdir.0 00000080:00200000:3.0:1717018619.221997:0:17467:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58) 00000080:00200000:3.0:1717018619.222002:0:17467:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2ce2:0x0], updating i_size 512 00010000:00010000:2.0:1717018620.124928:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018621.127309:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018622.129144:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018622.864833:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643712:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018622.864877:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838643648:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018622.864910:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8971300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643840:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018622.865020:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838643776:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018622.875984:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643712:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018622.875999:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8971300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643840:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018622.876017:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838643648:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018622.876036:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838643776:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717018623.130900:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018624.133880:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018625.138100:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018626.140838:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018627.143326:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018627.872755:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643968:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018627.872824:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644096:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018627.872845:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018627.872849:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8971300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838643904:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018627.872875:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644032:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018627.874272:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644032:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018627.874281:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644096:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018627.879102:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8971300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838643904:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018627.879122:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838643968:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717018628.146272:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018629.146892:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018629.998508:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018629.998762:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018629.999107:0:4622:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819849920 00000100:00100000:3.0:1717018629.999138:0:4622:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819849984 00000100:00100000:3.0:1717018629.999151:0:4622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77840 00000100:00100000:3.0:1717018629.999156:0:4622:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8973440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+4:20992:x1800422819849920:12345-192.168.203.126@tcp:104: 00000100:00100000:2.0:1717018629.999254:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77841 00000100:00100000:2.0:1717018629.999257:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a89776c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:20992:x1800422819849984:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018629.999388:0:4622:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018629.999394:0:4622:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8973440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+4:20992:x1800422819849920:12345-192.168.203.126@tcp:104: Request processed in 237us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018629.999400:0:4622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77840 00010000:00010000:2.0:1717018629.999754:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1717018629.999759:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a89776c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+3:20992:x1800422819849984:12345-192.168.203.126@tcp:104: Request processed in 501us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018629.999765:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77841 00010000:00010000:2.0:1717018629.999778:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1717018629.999783:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999791:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a89386c0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:2.0:1717018629.999793:0:10309:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999798:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018629.999802:0:10309:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018629.999805:0:10309:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018629.999837:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999842:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018629.999862:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999866:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a365da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c10ac expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999877:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1717018629.999878:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999882:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8939200 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:2.0:1717018629.999883:0:10309:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999887:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018629.999891:0:10309:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018629.999894:0:10309:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018629.999901:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999905:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018629.999907:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999911:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c10a5 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018629.999919:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018629.999920:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018629.999925:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018629.999936:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838644224:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:2.0:1717018629.999969:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1717018629.999973:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838644160:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:0.0:1717018630.000296:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018630.002125:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838644160:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018630.002135:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838644224:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018630.148959:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018631.151838:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1717018631.417685:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1717018631.417693:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 76 10000000:01000000:1.0:1717018631.417697:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1717018631.417740:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018631.417748:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018631.417756:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018631.417775:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644288:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717018631.417854:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387840 going to sleep for 6 seconds 00000100:00100000:1.0:1717018631.423831:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644288:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018631.423856:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018631.423865:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018631.423921:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644352:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018631.423977:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387840 going to sleep for 6 seconds 00000100:00100000:1.0:1717018631.434404:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644352:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018631.434473:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644416:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018631.434561:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387840 going to sleep for 6 seconds 00000100:00100000:1.0:1717018631.438472:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644416:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018631.439813:0:17656:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17656:1800422838644480:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018631.439898:0:17656:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387840 going to sleep for 6 seconds 00000100:00100000:1.0:1717018631.446607:0:17656:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17656:1800422838644480:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018631.446657:0:17656:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018631.446666:0:17656:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018631.446668:0:17656:0:(obd_config.c:1460:class_process_config()) marker 50 (0x1) lustre-clilov new lustre.test_20e 00000020:01000000:1.0:1717018631.446672:0:17656:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018631.446675:0:17656:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1717018631.446694:0:17656:0:(lov_pool.c:313:lov_pool_new()) test_20e is pool #2 00000100:00100000:1.0:1717018631.446727:0:17656:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17656:1800422838644544:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018631.446801:0:17656:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018631.448965:0:17656:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17656:1800422838644544:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018631.449009:0:17656:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018631.449015:0:17656:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018631.449017:0:17656:0:(obd_config.c:1460:class_process_config()) marker 50 (0x2) lustre-clilov new lustre.test_20e 00000040:00080000:1.0:1717018631.449021:0:17656:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 79 count 78 00000020:01000000:2.0:1717018631.449475:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 76-78 (rc=0) 10000000:01000000:2.0:1717018631.449496:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018631.449502:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018631.449513:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018631.449520:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717018631.449522:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:2.0:1717018631.449523:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717018631.449549:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018631.449555:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018631.449561:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018631.449577:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644608:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018631.449643:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a88806c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018631.452483:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644608:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018631.452513:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018631.452525:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018631.452633:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644672:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018631.452687:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018631.457980:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838644672:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717018631.458030:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717018631.458038:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018631.458060:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018632.153556:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018632.880973:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644800:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018632.881047:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644928:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018632.881086:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018632.881091:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838644736:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018632.881105:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644864:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018632.886320:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838644736:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018632.886340:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644864:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018632.886351:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644800:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018632.886366:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838644928:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018633.042822:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018633.043171:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018633.044348:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819853184 00000100:00100000:3.0:1717018633.044388:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819853248 00000100:00100000:3.0:1717018633.044400:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77842 00000100:00100000:3.0:1717018633.044413:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8972ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:21187:x1800422819853184:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018633.044490:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018633.044494:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8972ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:21187:x1800422819853184:12345-192.168.203.126@tcp:104: Request processed in 82us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018633.044500:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77842 00000100:00100000:3.0:1717018633.044512:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77843 00000100:00100000:3.0:1717018633.044515:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8971300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+3:21187:x1800422819853248:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018633.044545:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018633.044548:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8971300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+3:21187:x1800422819853248:12345-192.168.203.126@tcp:104: Request processed in 33us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018633.044553:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77843 00010000:00010000:0.0:1717018633.044850:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717018633.044855:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044863:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d8c0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018633.044866:0:10309:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044873:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018633.044877:0:10309:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018633.044881:0:10309:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018633.044907:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044910:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018633.044921:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044925:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809d8c0/0xe1aedd3f13a365f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1154 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044936:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018633.044938:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044949:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f22ac0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018633.044951:0:10309:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044955:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018633.044958:0:10309:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018633.044961:0:10309:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018633.044970:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044974:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018633.044977:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044980:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f22ac0/0xe1aedd3f13a365ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c114d expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018633.044987:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018633.044988:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018633.044989:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018633.045006:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838645056:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018633.045041:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1717018633.045045:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838644992:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1717018633.045133:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018633.047197:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838644992:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018633.047217:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838645056:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018633.155799:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018634.158021:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1717018634.813696:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1717018634.813703:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 79 10000000:01000000:0.0:1717018634.813708:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1717018634.813745:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018634.813759:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018634.813766:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018634.813792:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645120:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018634.813880:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0b40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018634.816506:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645120:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018634.816526:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c11c4 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018634.816534:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c11c4 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018634.816603:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645184:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018634.816648:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0b40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018634.822905:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645184:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018634.822954:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645248:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018634.823026:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0b40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018634.825374:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645248:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018634.825714:0:17701:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17701:1800422838645312:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018634.825956:0:17701:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387600 going to sleep for 6 seconds 00000100:00100000:1.0:1717018634.830645:0:17701:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17701:1800422838645312:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018634.830682:0:17701:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018634.830689:0:17701:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018634.830690:0:17701:0:(obd_config.c:1460:class_process_config()) marker 52 (0x1) lustre-clilov add lustre.test_20e.lustre-OST0000_UUID 00000020:01000000:1.0:1717018634.830694:0:17701:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018634.830696:0:17701:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1717018634.830705:0:17701:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_20e as member 1 00000100:00100000:1.0:1717018634.830730:0:17701:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17701:1800422838645376:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018634.830799:0:17701:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387600 going to sleep for 6 seconds 00000100:00100000:1.0:1717018634.832404:0:17701:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:17701:1800422838645376:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018634.832427:0:17701:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018634.832431:0:17701:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018634.832432:0:17701:0:(obd_config.c:1460:class_process_config()) marker 52 (0x2) lustre-clilov add lustre.test_20e.lustre-OST0000_UUID 00000040:00080000:1.0:1717018634.832435:0:17701:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 82 count 81 00000020:01000000:0.0:1717018634.832558:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 79-81 (rc=0) 10000000:01000000:0.0:1717018634.832579:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717018634.832606:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c11c4 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018634.832615:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8939200/0xe1aedd3f13a365fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c11c4 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018634.832622:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717018634.832624:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:0.0:1717018634.832625:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717018634.832644:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a36604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018634.832649:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a36604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018634.832655:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a36604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018634.832667:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645440:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018634.832706:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0b40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018634.833804:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645440:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018634.833818:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a36604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c11cb expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018634.833825:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a36604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c11cb expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018634.833872:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645504:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018634.833914:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0b40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018634.835259:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838645504:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717018634.835287:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717018634.835292:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a36604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c11cb expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018634.835299:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a89386c0/0xe1aedd3f13a36604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c11cb expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018635.160743:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1717018635.515035:0:17723:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018635.515057:0:17723:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018635.515073:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.515085:0:17723:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018635.515094:0:17723:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018635.515097:0:17723:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018635.515103:0:17723:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a3703af8 00010000:00010000:1.0:1717018635.515106:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.515111:0:17723:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018635.515126:0:17723:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018635.515135:0:17723:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=16 00000080:00200000:1.0:1717018635.515139:0:17723:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=0 00000002:00010000:1.0:1717018635.515146:0:17723:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d20e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018635.515183:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.515193:0:17723:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.515202:0:17723:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018635.515225:0:17723:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838645568:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018635.515308:0:17723:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387e40 going to sleep for 87 seconds 00000100:00100000:1.0:1717018635.523368:0:17723:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838645568:192.168.203.126@tcp:101:lfs.0 00010000:00010000:1.0:1717018635.523390:0:17723:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523405:0:17723:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523410:0:17723:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523417:0:17723:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523424:0:17723:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523431:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523436:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523448:0:17723:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018635.523456:0:17723:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a93e6d40 x1800422838645568/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018724 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1717018635.523464:0:17723:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523471:0:17723:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589935617/11490 (0 0) 00000080:00200000:1.0:1717018635.523490:0:17723:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2ce2:0x0], updating i_size 11776 00000080:00200000:1.0:1717018635.523492:0:17723:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x2ce2:0x0](ffff8800b0a66d58): rc = 0 00000080:00010000:1.0:1717018635.523497:0:17723:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2ce2:0x0](ffff8800b0a66d58) for lock 0xe1aedd3f13a3660b 00000080:00010000:1.0:1717018635.523506:0:17723:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x2ce2:0x0](ffff8800b0a66d58) 00000080:00010000:1.0:1717018635.523508:0:17723:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a3660b from it ffff8800a3703a70 00010000:00010000:1.0:1717018635.523510:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523515:0:17723:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018635.523540:0:17723:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58), inode mode 41ed mask 1 00000080:00200000:1.0:1717018635.523550:0:17723:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58), flags=0 00000080:00200000:1.0:1717018635.523553:0:17723:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58), intent=getattr 00000002:00010000:1.0:1717018635.523564:0:17723:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f20e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x2ce2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1717018635.523611:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523623:0:17723:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018635.523630:0:17723:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018635.523646:0:17723:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838645632:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018635.523696:0:17723:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387e40 going to sleep for 87 seconds 00000100:00100000:0.0:1717018635.528389:0:17723:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e6d40 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838645632:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717018635.528411:0:17723:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528423:0:17723:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528428:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528434:0:17723:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528440:0:17723:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528457:0:17723:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f23180 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018635.528461:0:17723:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528466:0:17723:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528471:0:17723:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528476:0:17723:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717018635.528480:0:17723:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528484:0:17723:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f23180/0xe1aedd3f13a36612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018635.528509:0:17723:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a93e6d40 x1800422838645632/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018724 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:0.0:1717018635.528578:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528609:0:17723:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1717018635.528616:0:17723:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a3660b from it ffff8800a37039f0 00010000:00010000:0.0:1717018635.528619:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528632:0:17723:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018635.528710:0:17723:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717018635.528722:0:17723:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1717018635.528728:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528734:0:17723:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1717018635.528741:0:17723:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:0.0:1717018635.528743:0:17723:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:0.0:1717018635.528746:0:17723:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a3703bb0 00010000:00010000:0.0:1717018635.528748:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528752:0:17723:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018635.528758:0:17723:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:0.0:1717018635.528765:0:17723:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d20e.sanity-pfl, flags=17 00000080:00200000:0.0:1717018635.528767:0:17723:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58), inode mode 41ed mask 1 00000080:00200000:0.0:1717018635.528772:0:17723:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f20e.sanity-pfl, flags=769 00000080:00200000:0.0:1717018635.528775:0:17723:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58), inode mode 41ed mask 3 00000080:00200000:0.0:1717018635.528779:0:17723:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58), file ffff8800b6e29680, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1717018635.528785:0:17723:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58), intent=open|creat 00000002:00010000:0.0:1717018635.528802:0:17723:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f20e.sanity-pfl,[0x200000401:0x2ce3:0x0]) in obj [0x200000401:0x2ce2:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1717018635.528811:0:17723:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528848:0:17723:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 1/0,0 mode: --/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528853:0:17723:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018635.528854:0:17723:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22d00/0xe1aedd3f13a3660b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c11e7 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528877:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2ce2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.528882:0:17723:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1717018635.528891:0:17723:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1717018635.528895:0:17723:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa617c0 x1800422838645760/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1717018635.528902:0:17723:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018635.528920:0:17723:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838645760:192.168.203.126@tcp:101:lfs.0 00000100:00100000:0.0:1717018635.529167:0:17723:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 87 seconds 00000100:00100000:0.0:1717018635.534115:0:17723:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa617c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838645760:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717018635.534136:0:17723:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534167:0:17723:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534172:0:17723:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534179:0:17723:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534186:0:17723:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534195:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534200:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534204:0:17723:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018635.534212:0:17723:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff88012fa617c0 x1800422838645760/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018724 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1717018635.534220:0:17723:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012fa617c0 x1800422838645760/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018724 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1717018635.534226:0:17723:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534241:0:17723:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 16 res 8589935617/11491 (0 0) 00000080:00200000:0.0:1717018635.534255:0:17723:0:(namei.c:1405:ll_create_it()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x2ce2:0x0](ffff8800b0a66d58), intent=open|creat 00000080:00200000:0.0:1717018635.534272:0:17723:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2ce3:0x0](ffff8800b0a33ed8) 00000080:00200000:0.0:1717018635.534276:0:17723:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2ce3:0x0], updating i_size 0 00000080:00200000:0.0:1717018635.534301:0:17723:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x2ce3:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1717018635.534304:0:17723:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x2ce3:0x0](ffff8800b0a33ed8) 00000080:00010000:0.0:1717018635.534307:0:17723:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2ce3:0x0](ffff8800b0a33ed8) for lock 0xe1aedd3f13a36619 00000080:00200000:0.0:1717018635.534316:0:17723:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x2ce3:0x0](ffff8800b0a33ed8), flags 120501 00000002:00100000:0.0:1717018635.534326:0:17723:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012fa617c0 x1800422838645760/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018724 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:0.0:1717018635.534386:0:17723:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a36619 from it ffff8800a8515600 00010000:00010000:0.0:1717018635.534388:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534394:0:17723:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018635.534406:0:17723:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2ce3:0x0](ffff8800b0a33ed8), inode mode 81a4 mask 40 00000080:00200000:0.0:1717018635.534466:0:17723:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2ce3:0x0](ffff8800b0a33ed8), inode mode 81a4 mask 2 00000080:00200000:0.0:1717018635.534473:0:17723:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x2ce3:0x0](ffff8800b0a33ed8), xattr lov 00000002:00010000:0.0:1717018635.534480:0:17723:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x2ce3:0x0]) in obj [0x200000401:0x2ce2:0x0], intent: open flags 040000002 00010000:00010000:0.0:1717018635.534511:0:17723:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.534514:0:17723:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1717018635.534526:0:17723:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1717018635.534529:0:17723:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa62140 x1800422838645888/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1717018635.534533:0:17723:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018635.534544:0:17723:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838645888:192.168.203.126@tcp:101:lfs.0 00000100:00100000:0.0:1717018635.534620:0:17723:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 87 seconds 00000100:00100000:3.0:1717018635.538129:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018635.538377:0:18297:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819856000 00000100:00100000:2.0:1717018635.538435:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77844 00000100:00100000:2.0:1717018635.538441:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a24280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:12cff408-c572-49fa-81b0-09052c8e7f41+5:8489:x1800422819856000:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717018635.538500:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717018635.538504:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a24280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:12cff408-c572-49fa-81b0-09052c8e7f41+5:8489:x1800422819856000:12345-192.168.203.126@tcp:104: Request processed in 64us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018635.538509:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77844 00010000:00010000:0.0:1717018635.538553:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018635.538558:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.538566:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8938480 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018635.538569:0:10309:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.538574:0:10309:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.538579:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018635.538617:0:10309:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x2ce3:0x0]: losing layout lock 00010000:00010000:0.0:1717018635.538647:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.538651:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018635.538676:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.538685:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938480/0xe1aedd3f13a36619 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2ce3:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1218 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018635.538699:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018635.538700:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018635.538702:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018635.538707:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1717018635.538719:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838645952:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018635.540170:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838645952:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1717018636.162911:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018637.165632:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018637.888789:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646080:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018637.888857:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646208:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018637.888877:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838646016:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018637.888939:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838646144:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018637.894287:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838646016:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018637.894307:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838646144:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018637.896249:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646080:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018637.896264:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646208:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717018638.168514:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018639.169774:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018640.170811:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018641.172760:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018642.177281:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018642.896763:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646336:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018642.896830:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646464:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018642.896865:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018642.896868:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838646272:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018642.896879:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646400:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018642.906287:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646336:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018642.908061:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646464:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018642.908083:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838646272:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018642.908092:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646400:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717018643.180956:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018644.183056:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018645.184929:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018646.187614:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018647.188983:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018647.904827:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646592:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018647.904940:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838646528:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018647.905033:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838646656:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018647.905422:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646720:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018647.906978:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838646528:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018647.906994:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838646656:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018647.907074:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646592:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018647.907097:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646720:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717018648.191150:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018649.193191:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018650.195134:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018651.198106:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018652.201091:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018652.912789:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646848:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018652.912856:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646976:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018652.912893:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018652.912897:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838646784:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018652.912910:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646912:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018652.915055:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838646784:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018652.915988:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646912:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018652.915997:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646976:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018652.916211:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838646848:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717018653.202813:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018654.205113:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018655.207386:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018655.542267:0:17723:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838645888:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717018655.542286:0:17723:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542298:0:17723:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542303:0:17723:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542308:0:17723:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542314:0:17723:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542319:0:17723:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8938240 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018655.542329:0:17723:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542334:0:17723:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542339:0:17723:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542343:0:17723:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717018655.542346:0:17723:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018655.542350:0:17723:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938240/0xe1aedd3f13a36620 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2ce2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17723 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018655.542478:0:17723:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff88012fa62140 x1800422838645888/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/600 e 0 to 0 dl 1717018724 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1717018655.542493:0:17723:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1717018655.542561:0:17723:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x2ce3:0x0](ffff8800b0a33ed8) 00000002:00100000:0.0:1717018655.542613:0:17723:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012fa617c0 x1800422838645760/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018724 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1717018655.542631:0:17723:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1717018655.542634:0:17723:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa62140 x1800422838647104/t0(0) o35->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1717018655.542649:0:17723:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838647104:192.168.203.126@tcp:35:lfs.0 00000100:00100000:0.0:1717018655.542696:0:17723:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018655.544200:0:17723:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:17723:1800422838647104:192.168.203.126@tcp:35:lfs.0 00000002:00100000:0.0:1717018655.544234:0:17723:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012fa617c0 x1800422838645760/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018724 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000400:00000080:1.0:1717018656.114478:0:17870:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717018656.114482:0:17870:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_20e: @@@@@@ FAIL: Create /mnt/lustre/d20e.sanity-pfl/f20e.sanity-pfl failed 00010000:00010000:2.0:1717018656.214723:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 803 lines, 803 kept, 0 dropped, 0 bad.