00010000:00010000:3.0F:1717019064.108745:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1717019065.111490:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019065.410886:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717019065.410926:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0F:1717019065.410993:0:4619:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944000 00000100:00100000:3.0:1717019065.411060:0:10294:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0F:1717019065.411063:0:10301:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2693 00000100:00100000:3.0:1717019065.411070:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819943936 00000100:00100000:0.0:1717019065.411074:0:10301:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8975f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:461e9689-0dac-4669-87c3-00abdddc539f+4:2228:x1800422819944000:12345-192.168.203.126@tcp:104: 00000100:00100000:3.0:1717019065.411088:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77888 00000100:00100000:3.0:1717019065.411091:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aaf00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:2228:x1800422819943936:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717019065.411333:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1717019065.411337:0:10301:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717019065.411339:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aaf00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:2228:x1800422819943936:12345-192.168.203.126@tcp:104: Request processed in 246us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019065.411342:0:10301:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8975f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:461e9689-0dac-4669-87c3-00abdddc539f+4:2228:x1800422819944000:12345-192.168.203.126@tcp:104: Request processed in 269us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019065.411345:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77888 00000100:00100000:0.0:1717019065.411347:0:10301:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2693 00010000:00010000:0.0:1717019065.411369:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717019065.411373:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411380:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809c240 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717019065.411398:0:10309:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411403:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717019065.411408:0:10309:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019065.411411:0:10309:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717019065.411436:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411439:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717019065.411452:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411455:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809c240/0xe1aedd3f13a368dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20b2 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411463:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717019065.411467:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411470:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809fa80 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717019065.411471:0:10309:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411473:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717019065.411475:0:10309:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019065.411477:0:10309:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717019065.411483:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411486:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717019065.411488:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411490:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a368d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20ab expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.411495:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019065.411496:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019065.411496:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717019065.411508:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838689088:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:1.0:1717019065.411517:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838689024:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:2.0:1717019065.411562:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019065.412825:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838689024:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:0.0:1717019065.412856:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838689088:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1717019066.114706:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1717019066.909684:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1717019066.909689:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 138 10000000:01000000:3.0:1717019066.909693:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1717019066.909724:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019066.909731:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019066.909738:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019066.909755:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689152:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1717019066.909916:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff880130e22000 going to sleep for 6 seconds 00000100:00100000:3.0:1717019066.911034:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689152:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717019066.911047:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019066.911053:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019066.911117:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689216:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019066.911152:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff880130e22000 going to sleep for 6 seconds 00000100:00100000:3.0:1717019066.912928:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689216:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019066.912963:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689280:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019066.913001:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff880130e22000 going to sleep for 6 seconds 00000100:00100000:3.0:1717019066.914704:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689280:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019066.915009:0:28367:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:28367:1800422838689344:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717019066.915054:0:28367:0:(client.c:2492:ptlrpc_set_wait()) set ffff880130e22000 going to sleep for 6 seconds 00000100:00100000:3.0:1717019066.916879:0:28367:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:28367:1800422838689344:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:3.0:1717019066.916902:0:28367:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1717019066.916907:0:28367:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717019066.916908:0:28367:0:(obd_config.c:1460:class_process_config()) marker 90 (0x1) lustre-clilov rem lustre.test_23e.lustre-OST0000_UUID 00000020:01000000:3.0:1717019066.916911:0:28367:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:3.0:1717019066.916912:0:28367:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1717019066.916919:0:28367:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from test_23e 00000100:00100000:3.0:1717019066.916935:0:28367:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:28367:1800422838689408:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717019066.916971:0:28367:0:(client.c:2492:ptlrpc_set_wait()) set ffff880130e22000 going to sleep for 6 seconds 00000100:00100000:3.0:1717019066.918106:0:28367:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:28367:1800422838689408:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:3.0:1717019066.918126:0:28367:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1717019066.918129:0:28367:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717019066.918130:0:28367:0:(obd_config.c:1460:class_process_config()) marker 90 (0x2) lustre-clilov rem lustre.test_23e.lustre-OST0000_UUID 00000040:00080000:3.0:1717019066.918133:0:28367:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 141 count 138 00000020:01000000:0.0:1717019066.918190:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 138-140 (rc=0) 10000000:01000000:0.0:1717019066.918206:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717019066.918215:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019066.918223:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019066.918228:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717019066.918230:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:0.0:1717019066.918232:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717019066.918250:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019066.918254:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019066.918260:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019066.918270:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689472:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717019066.918295:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0e40 going to sleep for 6 seconds 00000100:00100000:0.0:1717019066.919780:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689472:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019066.919797:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019066.919806:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019066.919849:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689536:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019066.919875:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0e40 going to sleep for 6 seconds 00000100:00100000:0.0:1717019066.921498:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689536:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717019066.921529:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717019066.921534:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019066.921540:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.118005:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019068.121087:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019068.154783:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717019068.154922:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717019068.155135:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947200 00000100:00100000:3.0:1717019068.155232:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947584 00000100:00100000:2.0:1717019068.155236:0:4621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77889 00000100:00100000:2.0:1717019068.155242:0:4621:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8977200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+4:2370:x1800422819947200:12345-192.168.203.126@tcp:104: 00000100:00100000:3.0:1717019068.155249:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77890 00000100:00100000:3.0:1717019068.155252:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a89750c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:2370:x1800422819947584:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717019068.155312:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1717019068.155314:0:4621:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717019068.155317:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a89750c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:2370:x1800422819947584:12345-192.168.203.126@tcp:104: Request processed in 64us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.155317:0:4621:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8977200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+4:2370:x1800422819947200:12345-192.168.203.126@tcp:104: Request processed in 76us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.155323:0:4621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77889 00000100:00100000:3.0:1717019068.155325:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77890 00010000:00010000:3.0:1717019068.155357:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1717019068.155362:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155385:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a85c9f80 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:3.0:1717019068.155388:0:10237:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155394:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717019068.155400:0:10237:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717019068.155404:0:10237:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717019068.155743:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155750:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717019068.155771:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155776:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a85c9f80/0xe1aedd3f13a368ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2122 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155801:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1717019068.155803:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.155807:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019068.155811:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a893bcc0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:3.0:1717019068.155813:0:10237:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155818:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717019068.155821:0:10237:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717019068.155828:0:10237:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717019068.155840:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155844:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717019068.155848:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155852:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2129 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.155860:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019068.155861:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019068.155863:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019068.156174:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838689600:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019068.156469:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1717019068.156475:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a26d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838689664:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1717019068.159060:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a26d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838689664:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1717019068.159074:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838689600:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019068.576838:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838689792:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019068.576927:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838689920:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019068.576951:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019068.576956:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838689728:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019068.576970:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838689856:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019068.579781:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838689856:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019068.579796:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838689920:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019068.580024:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838689728:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019068.580197:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838689792:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717019069.122824:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1717019069.594189:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1717019069.594194:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 141 10000000:01000000:1.0:1717019069.594198:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1717019069.594228:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a3690d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019069.594236:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a3690d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019069.594243:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a3690d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019069.594262:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689984:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717019069.597977:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f540 going to sleep for 6 seconds 00000100:00100000:1.0:1717019069.611957:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838689984:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717019069.611977:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a3690d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21fb expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019069.611986:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a3690d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c21fb expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019069.612039:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838690048:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019069.612087:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f540 going to sleep for 6 seconds 00000100:00100000:1.0:1717019069.615853:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838690048:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019069.615901:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838690112:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019069.615947:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f540 going to sleep for 6 seconds 00000100:00100000:1.0:1717019069.624368:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838690112:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019069.624690:0:28405:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:28405:1800422838690176:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717019069.624754:0:28405:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f540 going to sleep for 6 seconds 00000100:00100000:0.0:1717019069.642802:0:28405:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:28405:1800422838690176:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:0.0:1717019069.642839:0:28405:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1717019069.642846:0:28405:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717019069.642847:0:28405:0:(obd_config.c:1460:class_process_config()) marker 92 (0x1) lustre-clilov del lustre.test_23e 00000020:01000000:0.0:1717019069.642851:0:28405:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:0.0:1717019069.642853:0:28405:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1717019069.642891:0:28405:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:28405:1800422838690240:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:0.0:1717019069.642985:0:28405:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 6 seconds 00000100:00100000:0.0:1717019069.647066:0:28405:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:28405:1800422838690240:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:0.0:1717019069.647100:0:28405:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1717019069.647105:0:28405:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717019069.647107:0:28405:0:(obd_config.c:1460:class_process_config()) marker 92 (0x2) lustre-clilov del lustre.test_23e 00000040:00080000:0.0:1717019069.647110:0:28405:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 144 count 141 00000020:01000000:2.0:1717019069.647223:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 141-143 (rc=0) 10000000:01000000:2.0:1717019069.647239:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717019069.647244:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a3690d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21fb expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019069.647257:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8f22d00/0xe1aedd3f13a3690d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21fb expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019069.647264:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717019069.647266:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:2.0:1717019069.647267:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717019069.647286:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019069.647291:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019069.647296:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019069.647312:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838690304:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019069.647368:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a88800c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019069.651378:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838690304:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019069.651397:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2202 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019069.651406:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c2202 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019069.651469:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838690368:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019069.651515:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0000 going to sleep for 6 seconds 00000100:00100000:0.0:1717019069.655578:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838690368:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717019069.655804:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717019069.655810:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2202 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019069.655819:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2202 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019070.124770:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019071.127290:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019072.128807:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019073.130829:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019073.585111:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838690496:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019073.585263:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838690624:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019073.585286:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019073.585290:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838690432:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019073.585302:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838690560:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019073.587339:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838690496:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019073.587352:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838690624:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019073.587373:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838690432:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019073.587379:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838690560:192.168.203.126@tcp:400:kworker/u8:4.0 00000400:00000080:1.0:1717019073.767760:0:28682:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717019073.767764:0:28682:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 23f: Append with low on space: repeat and remove EXT comp ========================================================== 17:44:33 (1717019073) 00000080:00200000:0.0:1717019073.837926:0:28546:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717019073.837942:0:28546:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1717019073.837953:0:28546:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.837962:0:28546:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1717019073.837970:0:28546:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:0.0:1717019073.837972:0:28546:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:0.0:1717019073.837977:0:28546:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8413af8 00010000:00010000:0.0:1717019073.837979:0:28546:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.837984:0:28546:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717019073.838001:0:28546:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:0.0:1717019073.838008:0:28546:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23f.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1 00000080:00200000:0.0:1717019073.838011:0:28546:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23f.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=getattr 00000002:00010000:0.0:1717019073.838017:0:28546:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23f.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1717019073.838048:0:28546:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.838053:0:28546:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.838059:0:28546:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019073.838076:0:28546:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:28546:1800422838690688:192.168.203.126@tcp:101:bash.0 00000100:00100000:0.0:1717019073.838125:0:28546:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0c00 going to sleep for 80 seconds 00000100:00100000:0.0:1717019073.842516:0:28546:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:28546:1800422838690688:192.168.203.126@tcp:101:bash.0 00010000:00010000:0.0:1717019073.842539:0:28546:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842553:0:28546:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842560:0:28546:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842566:0:28546:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842620:0:28546:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842626:0:28546:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8938000 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717019073.842630:0:28546:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842636:0:28546:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842641:0:28546:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842647:0:28546:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717019073.842651:0:28546:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842656:0:28546:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938000/0xe1aedd3f13a3691b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717019073.842671:0:28546:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff88012fa676c0 x1800422838690688/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019154 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:0.0:1717019073.842703:0:28546:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1717019073.842863:0:28546:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717019073.842875:0:28546:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1717019073.842879:0:28546:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:0.0:1717019073.842912:0:28546:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842926:0:28546:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.842933:0:28546:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019073.842951:0:28546:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:28546:1800422838690752:192.168.203.126@tcp:101:bash.0 00000100:00100000:0.0:1717019073.843017:0:28546:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0c00 going to sleep for 80 seconds 00000100:00100000:0.0:1717019073.844513:0:28546:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:28546:1800422838690752:192.168.203.126@tcp:101:bash.0 00010000:00010000:0.0:1717019073.844530:0:28546:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.844538:0:28546:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.844547:0:28546:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.844556:0:28546:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.844567:0:28546:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.844573:0:28546:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.844578:0:28546:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717019073.844630:0:28546:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88012fa676c0 x1800422838690752/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1717019154 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:0.0:1717019073.844640:0:28546:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.844647:0:28546:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1717019073.844671:0:28546:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 14848 00000080:00010000:0.0:1717019073.844678:0:28546:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a36922 00000080:00010000:0.0:1717019073.844683:0:28546:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:0.0:1717019073.844685:0:28546:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a36922 from it ffff8800a8413cf8 00010000:00010000:0.0:1717019073.844687:0:28546:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.844692:0:28546:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717019073.848719:0:28706:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717019073.848741:0:28706:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717019073.848754:0:28706:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.848767:0:28706:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717019073.848776:0:28706:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717019073.848779:0:28706:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717019073.848785:0:28706:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800abcabb58 00010000:00010000:1.0:1717019073.848788:0:28706:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.848793:0:28706:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717019073.848807:0:28706:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717019073.848816:0:28706:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23f.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1536 00000080:00200000:1.0:1717019073.848823:0:28706:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717019073.848827:0:28706:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717019073.848831:0:28706:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.848837:0:28706:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717019073.848842:0:28706:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717019073.848843:0:28706:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717019073.848846:0:28706:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800abcabbf8 00010000:00010000:1.0:1717019073.848847:0:28706:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.848852:0:28706:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717019073.848858:0:28706:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:1.0:1717019073.848861:0:28706:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717019073.848864:0:28706:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717019073.848866:0:28706:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.848871:0:28706:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717019073.848875:0:28706:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717019073.848877:0:28706:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717019073.848879:0:28706:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800abcabda0 00010000:00010000:1.0:1717019073.848884:0:28706:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.848889:0:28706:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717019073.848894:0:28706:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:1.0:1717019073.848898:0:28706:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d23f.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8) 00800000:00000004:1.0:1717019073.848911:0:28706:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800b604b800: age 1548, max_age 0 00000100:00100000:1.0:1717019073.848966:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838690816:192.168.203.126@tcp:41:mkdir.0 00010000:00010000:0.0:1717019073.849303:0:28706:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.849319:0:28706:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.849370:0:28706:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.849375:0:28706:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717019073.849377:0:28706:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938900/0xe1aedd3f13a36922 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c2225 expref: -99 pid: 28546 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1717019073.849399:0:28706:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1717019073.849404:0:28706:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa676c0 x1800422838690944/t0(0) o36->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1717019073.849418:0:28706:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:28706:1800422838690944:192.168.203.126@tcp:36:mkdir.0 00000100:00100000:0.0:1717019073.850070:0:28706:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0c00 going to sleep for 80 seconds 00000100:00100000:1.0:1717019073.851962:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838690816:192.168.203.126@tcp:41:mkdir.0 00000100:00100000:0.0:1717019073.852801:0:28706:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:28706:1800422838690944:192.168.203.126@tcp:36:mkdir.0 00000080:00200000:0.0:1717019073.852838:0:28706:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058) 00000080:00200000:0.0:1717019073.852843:0:28706:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cfc:0x0], updating i_size 512 00000080:00200000:3.0:1717019073.857860:0:28707:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717019073.857875:0:28707:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717019073.857886:0:28707:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.857896:0:28707:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717019073.857904:0:28707:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717019073.857906:0:28707:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717019073.857911:0:28707:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a85bbaf8 00010000:00010000:3.0:1717019073.857913:0:28707:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.857921:0:28707:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717019073.857931:0:28707:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:3.0:1717019073.857938:0:28707:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23f.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=16 00000080:00200000:3.0:1717019073.857941:0:28707:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23f.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=0 00000002:00010000:3.0:1717019073.857947:0:28707:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23f.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717019073.857978:0:28707:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.857983:0:28707:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.857990:0:28707:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019073.858006:0:28707:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838691008:192.168.203.126@tcp:101:lfs.0 00000100:00100000:3.0:1717019073.858105:0:28707:0:(client.c:2492:ptlrpc_set_wait()) set ffff880136881f00 going to sleep for 80 seconds 00000100:00100000:3.0:1717019073.860782:0:28707:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838691008:192.168.203.126@tcp:101:lfs.0 00010000:00010000:3.0:1717019073.860797:0:28707:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860809:0:28707:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860814:0:28707:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860830:0:28707:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860836:0:28707:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860844:0:28707:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860849:0:28707:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860853:0:28707:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1717019073.860860:0:28707:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff880136a23dc0 x1800422838691008/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019154 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1717019073.860868:0:28707:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860874:0:28707:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589935617/11516 (0 0) 00000080:00200000:3.0:1717019073.860889:0:28707:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cfc:0x0], updating i_size 512 00000080:00200000:3.0:1717019073.860891:0:28707:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x2cfc:0x0](ffff8800b0ad9058): rc = 0 00000080:00010000:3.0:1717019073.860895:0:28707:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cfc:0x0](ffff8800b0ad9058) for lock 0xe1aedd3f13a36929 00000080:00010000:3.0:1717019073.860904:0:28707:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x2cfc:0x0](ffff8800b0ad9058) 00000080:00010000:3.0:1717019073.860906:0:28707:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a36929 from it ffff8800a85bba70 00010000:00010000:3.0:1717019073.860908:0:28707:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860917:0:28707:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca640/0xe1aedd3f13a36929 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c224f expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717019073.860937:0:28707:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058), inode mode 41ed mask 1 00000080:00200000:3.0:1717019073.860945:0:28707:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f23f.sanity-pfl, dir=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058), flags=0 00000080:00200000:3.0:1717019073.860948:0:28707:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23f.sanity-pfl, dir=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058), intent=getattr 00000002:00010000:3.0:1717019073.860955:0:28707:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23f.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x2cfc:0x0], intent: getattr flags 0 00010000:00010000:3.0:1717019073.860980:0:28707:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860985:0:28707:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.860991:0:28707:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019073.861004:0:28707:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838691072:192.168.203.126@tcp:101:lfs.0 00000100:00100000:3.0:1717019073.861038:0:28707:0:(client.c:2492:ptlrpc_set_wait()) set ffff880136881f00 going to sleep for 80 seconds 00000100:00100000:0.0:1717019073.866706:0:28707:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a23dc0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838691072:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717019073.866722:0:28707:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866733:0:28707:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866738:0:28707:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866742:0:28707:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866747:0:28707:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866752:0:28707:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a85c9f80 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717019073.866755:0:28707:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866767:0:28707:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866772:0:28707:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866777:0:28707:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717019073.866780:0:28707:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866784:0:28707:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c9f80/0xe1aedd3f13a36930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717019073.866796:0:28707:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff880136a23dc0 x1800422838691072/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019154 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:0.0:1717019073.866820:0:28707:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589935617/11516 (0 0) 00000080:00200000:0.0:1717019073.866877:0:28707:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717019073.866887:0:28707:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1717019073.866893:0:28707:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866900:0:28707:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1717019073.866907:0:28707:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:0.0:1717019073.866909:0:28707:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:0.0:1717019073.866912:0:28707:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a85bbbb0 00010000:00010000:0.0:1717019073.866914:0:28707:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.866923:0:28707:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717019073.866933:0:28707:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:0.0:1717019073.866939:0:28707:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d23f.sanity-pfl, flags=17 00000080:00200000:0.0:1717019073.866941:0:28707:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058), inode mode 41ed mask 1 00000080:00200000:0.0:1717019073.866948:0:28707:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058), inode mode 41ed mask 3 00000080:00200000:0.0:1717019073.866951:0:28707:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f23f.sanity-pfl, dir=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058), file ffff8800b62d7b00, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1717019073.866957:0:28707:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23f.sanity-pfl, dir=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058), intent=open|creat 00000002:00010000:0.0:1717019073.866968:0:28707:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23f.sanity-pfl,[0x200000401:0x2cfd:0x0]) in obj [0x200000401:0x2cfc:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1717019073.867405:0:28707:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.867411:0:28707:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1717019073.867419:0:28707:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1717019073.867423:0:28707:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa62600 x1800422838691200/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1717019073.867428:0:28707:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019073.867443:0:28707:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa62600 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838691200:192.168.203.126@tcp:101:lfs.0 00000100:00100000:0.0:1717019073.867535:0:28707:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0c00 going to sleep for 80 seconds 00000100:00100000:0.0:1717019073.870978:0:28707:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa62600 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838691200:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717019073.871005:0:28707:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871040:0:28707:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871046:0:28707:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871055:0:28707:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871063:0:28707:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871074:0:28707:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871079:0:28707:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871084:0:28707:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717019073.871091:0:28707:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff88012fa62600 x1800422838691200/t12884902050(12884902050) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019154 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1717019073.871101:0:28707:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012fa62600 x1800422838691200/t12884902050(12884902050) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019154 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1717019073.871110:0:28707:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871127:0:28707:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 16 res 8589935617/11517 (0 0) 00000080:00200000:0.0:1717019073.871149:0:28707:0:(namei.c:1405:ll_create_it()) VFS Op:name=f23f.sanity-pfl, dir=[0x200000401:0x2cfc:0x0](ffff8800b0ad9058), intent=open|creat 00000080:00200000:0.0:1717019073.871219:0:28707:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cfd:0x0](ffff8800b0adf518) 00000080:00200000:0.0:1717019073.871224:0:28707:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cfd:0x0], updating i_size 0 00000080:00200000:0.0:1717019073.871256:0:28707:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x2cfd:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1717019073.871261:0:28707:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x2cfd:0x0](ffff8800b0adf518) 00000080:00010000:0.0:1717019073.871264:0:28707:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cfd:0x0](ffff8800b0adf518) for lock 0xe1aedd3f13a36937 00000080:00200000:0.0:1717019073.871277:0:28707:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x2cfd:0x0](ffff8800b0adf518), flags 120501 00000002:00100000:0.0:1717019073.871290:0:28707:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012fa62600 x1800422838691200/t12884902050(12884902050) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019154 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:0.0:1717019073.871398:0:28707:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a36937 from it ffff8800a8515360 00010000:00010000:0.0:1717019073.871400:0:28707:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871407:0:28707:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717019073.871421:0:28707:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfd:0x0](ffff8800b0adf518), inode mode 81a4 mask 40 00000080:00200000:0.0:1717019073.871499:0:28707:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cfd:0x0](ffff8800b0adf518), inode mode 81a4 mask 2 00000080:00200000:0.0:1717019073.871507:0:28707:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x2cfd:0x0](ffff8800b0adf518), xattr lov 00000002:00010000:0.0:1717019073.871519:0:28707:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x2cfd:0x0]) in obj [0x200000401:0x2cfc:0x0], intent: open flags 040000002 00010000:00010000:0.0:1717019073.871565:0:28707:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.871571:0:28707:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1717019073.871617:0:28707:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1717019073.871621:0:28707:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bfa4c00 x1800422838691328/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1717019073.871627:0:28707:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019073.871645:0:28707:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfa4c00 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838691328:192.168.203.126@tcp:101:lfs.0 00000100:00100000:0.0:1717019073.871730:0:28707:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0b40 going to sleep for 80 seconds 00000100:00100000:3.0:1717019073.872992:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717019073.873040:0:4622:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950080 00000100:00100000:3.0:1717019073.873076:0:4622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77891 00000100:00100000:3.0:1717019073.873079:0:4622:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a26d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:12cff408-c572-49fa-81b0-09052c8e7f41+5:9645:x1800422819950080:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717019073.873141:0:4622:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717019073.873146:0:4622:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a26d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:12cff408-c572-49fa-81b0-09052c8e7f41+5:9645:x1800422819950080:12345-192.168.203.126@tcp:104: Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019073.873152:0:4622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77891 00010000:00010000:1.0:1717019073.873346:0:4630:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717019073.873350:0:4630:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.873360:0:4630:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8938d80 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:1.0:1717019073.873362:0:4630:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.873368:0:4630:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.873373:0:4630:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717019073.873390:0:4630:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x2cfd:0x0]: losing layout lock 00010000:00010000:1.0:1717019073.873417:0:4630:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.873428:0:4630:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717019073.873454:0:4630:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.873459:0:4630:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8938d80/0xe1aedd3f13a36937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c2280 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.873478:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019073.873478:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019073.873479:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019073.873484:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1717019073.873498:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838691392:192.168.203.126@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1717019073.875309:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838691392:192.168.203.126@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1717019074.132914:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019075.134764:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019076.137914:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019077.141615:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019078.143031:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019078.592769:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691520:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019078.592827:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691648:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019078.592848:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019078.592852:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838691456:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019078.592864:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691584:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019078.595121:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838691456:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019078.595135:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691584:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019078.595144:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691520:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019078.595152:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691648:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:2.0:1717019079.144948:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019080.148576:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019081.151193:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019082.152835:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019083.154757:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019083.600859:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691776:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019083.600860:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838691712:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019083.600912:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691904:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019083.600913:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838691840:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019083.604196:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691776:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019083.604208:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838691904:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019083.604316:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838691712:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019083.604325:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838691840:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:2.0:1717019084.156976:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019085.158810:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019086.162522:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019087.165693:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019088.168817:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019088.610413:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692032:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019088.610468:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692160:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019088.610483:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717019088.610486:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838691968:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019088.610496:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692096:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019088.618560:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838691968:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019088.618746:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692096:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019088.618754:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692032:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019088.618760:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692160:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:2.0:1717019089.170789:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019090.173098:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019091.175574:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019092.176809:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019093.178897:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019093.616850:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838692224:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019093.616880:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692288:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019093.616906:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692416:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019093.616910:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838692352:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019093.618568:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692288:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019093.618621:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838692224:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019093.618652:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838692416:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019093.618665:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838692352:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717019093.875259:0:28707:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bfa4c00 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838691328:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717019093.875277:0:28707:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875287:0:28707:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875292:0:28707:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875296:0:28707:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875301:0:28707:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875305:0:28707:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a893aac0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717019093.875308:0:28707:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875324:0:28707:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875329:0:28707:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875334:0:28707:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717019093.875337:0:28707:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019093.875341:0:28707:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3693e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 28707 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717019093.875369:0:28707:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff88012bfa4c00 x1800422838691328/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/600 e 0 to 0 dl 1717019154 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1717019093.875384:0:28707:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1717019093.875467:0:28707:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x2cfd:0x0](ffff8800b0adf518) 00000002:00100000:0.0:1717019093.875487:0:28707:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012fa62600 x1800422838691200/t12884902050(12884902050) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019154 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1717019093.875502:0:28707:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1717019093.875504:0:28707:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bfa4c00 x1800422838692544/t0(0) o35->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1717019093.875516:0:28707:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bfa4c00 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838692544:192.168.203.126@tcp:35:lfs.0 00000100:00100000:0.0:1717019093.875556:0:28707:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0c00 going to sleep for 6 seconds 00000100:00100000:0.0:1717019093.877059:0:28707:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bfa4c00 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:28707:1800422838692544:192.168.203.126@tcp:35:lfs.0 00000002:00100000:0.0:1717019093.877073:0:28707:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012fa62600 x1800422838691200/t12884902050(12884902050) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019154 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00010000:00010000:2.0:1717019094.180848:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1717019094.253310:0:28855:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717019094.253314:0:28855:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_23f: @@@@@@ FAIL: Create /mnt/lustre/d23f.sanity-pfl/f23f.sanity-pfl failed Debug log: 555 lines, 555 kept, 0 dropped, 0 bad.