00010000:00010000:2.0F:1761239680.831433:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1761239681.855536:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239682.879965:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239683.904072:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1761239684.095589:0:468:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761239684.095596:0:468:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1761239684.095598:0:468:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761239684.095600:0:468:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1761239684.095623:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875505472:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1761239684.095725:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1761239684.095732:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792875505536:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1761239684.101408:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792875505536:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1761239684.101422:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875505472:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:1.0F:1761239684.632625:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761239684.632701:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0F:1761239684.632803:0:4987:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1761239684.632834:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884129664 00000100:00100000:0.0:1761239684.632881:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884129728 00000100:00100000:0.0:1761239684.632896:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 194 00000100:00100000:0.0:1761239684.632902:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005348eead pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30196:x1846792884129664:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761239684.632918:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 000000001112d79d/0x39427fb11b5ed0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a2542 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239684.632992:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761239684.632997:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005348eead pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30196:x1846792884129664:12345-192.168.206.106@tcp:104: Request processed in 96us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239684.633004:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 194 00000100:00100000:0.0:1761239684.633023:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 195 00000100:00100000:0.0:1761239684.633027:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed563e0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:30196:x1846792884129728:12345-192.168.206.106@tcp:104: 00010000:00010000:3.0:1761239684.633033:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1761239684.633034:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000088b7db5d/0x39427fb11b5ed09d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a253b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633040:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 000000001112d79d/0x39427fb11b5ed0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a2542 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633049:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001112d79d already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239684.633052:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 000000001112d79d/0x39427fb11b5ed0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a2542 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633060:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 000000001112d79d/0x39427fb11b5ed0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a2542 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239684.633067:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 000000001112d79d/0x39427fb11b5ed0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a2542 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239684.633072:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1761239684.633077:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761239684.633083:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed563e0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:30196:x1846792884129728:12345-192.168.206.106@tcp:104: Request processed in 55us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239684.633090:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 195 00010000:00010000:3.0:1761239684.633108:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 000000001112d79d/0x39427fb11b5ed0a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2542 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633114:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239684.633133:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 000000001112d79d/0x39427fb11b5ed0a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2542 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633139:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 000000001112d79d/0x39427fb11b5ed0a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2542 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633152:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761239684.633154:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000088b7db5d/0x39427fb11b5ed09d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a253b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633159:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088b7db5d already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239684.633161:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000088b7db5d/0x39427fb11b5ed09d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a253b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633174:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000088b7db5d/0x39427fb11b5ed09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a253b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239684.633179:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000088b7db5d/0x39427fb11b5ed09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a253b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239684.633184:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239684.633196:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000088b7db5d/0x39427fb11b5ed09d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a253b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633202:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239684.633206:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000088b7db5d/0x39427fb11b5ed09d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a253b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633211:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000088b7db5d/0x39427fb11b5ed09d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a253b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239684.633223:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239684.633224:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239684.633225:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239684.633348:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1761239684.633367:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875505600:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761239684.633415:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1761239684.633421:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a69be96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875505664:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761239684.645101:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875505600:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761239684.645130:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a69be96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875505664:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1761239684.929771:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239685.951528:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1761239686.335584:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1761239686.335592:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 362 10000000:01000000:3.0:1761239686.335598:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1761239686.335645:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239686.335656:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239686.335665:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761239686.335711:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875505728:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1761239686.335799:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000021060874 going to sleep for 43 seconds 00000100:00100000:3.0:1761239686.345158:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875505728:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1761239686.345186:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239686.345201:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761239686.345293:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875505792:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1761239686.356479:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000021060874 going to sleep for 43 seconds 00000100:00100000:3.0:1761239686.358132:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875505792:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1761239686.358189:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875505856:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1761239686.365805:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000021060874 going to sleep for 43 seconds 00000100:00100000:3.0:1761239686.366980:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875505856:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1761239686.367375:0:30585:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003dcdc8a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30585:1846792875505920:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:0.0:1761239686.367469:0:30585:0:(client.c:2500:ptlrpc_set_wait()) set 000000009dca19b9 going to sleep for 43 seconds 00000100:00100000:2.0:1761239686.382462:0:30585:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003dcdc8a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30585:1846792875505920:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761239686.382509:0:30585:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1761239686.382520:0:30585:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761239686.382522:0:30585:0:(obd_config.c:1460:class_process_config()) marker 237 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:2.0:1761239686.382528:0:30585:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:2.0:1761239686.382538:0:30585:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1761239686.382549:0:30585:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:2.0:1761239686.382583:0:30585:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30585:1846792875505984:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761239686.382657:0:30585:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e2ee0465 going to sleep for 43 seconds 00000100:00100000:2.0:1761239686.392873:0:30585:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30585:1846792875505984:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761239686.392920:0:30585:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1761239686.392927:0:30585:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761239686.392929:0:30585:0:(obd_config.c:1460:class_process_config()) marker 237 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:2.0:1761239686.392933:0:30585:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 365 count 357 00000020:01000000:3.0:1761239686.393120:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 362-364 (rc=0) 10000000:01000000:3.0:1761239686.393144:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1761239686.393151:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239686.393161:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239686.393171:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1761239686.393183:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:3.0:1761239686.393186:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1761239686.393216:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239686.393222:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239686.393230:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761239686.393286:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506048:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1761239686.393349:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000021060874 going to sleep for 43 seconds 00000100:00100000:3.0:1761239686.396442:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506048:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1761239686.396469:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239686.396481:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761239686.396551:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506112:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1761239686.397460:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000021060874 going to sleep for 43 seconds 00000100:00100000:2.0:1761239686.407226:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506112:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1761239686.407314:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1761239686.407321:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239686.407331:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239686.975383:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239687.999763:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1761239688.462395:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761239688.462455:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761239688.462559:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884132096 00000100:00100000:0.0:1761239688.462612:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884132160 00000100:00100000:0.0:1761239688.462629:0:4986:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 196 00000100:00100000:0.0:1761239688.462636:0:4986:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000393bf147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30305:x1846792884132096:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761239688.462651:0:4986:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239688.462741:0:4986:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761239688.462768:0:4986:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000393bf147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30305:x1846792884132096:12345-192.168.206.106@tcp:104: Request processed in 111us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239688.462776:0:4986:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 196 00000100:00100000:0.0:1761239688.462793:0:4986:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 197 00000100:00100000:0.0:1761239688.462796:0:4986:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9c7dbf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:30305:x1846792884132160:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761239688.462802:0:4986:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239688.462843:0:4986:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1761239688.462847:0:4986:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9c7dbf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:30305:x1846792884132160:12345-192.168.206.106@tcp:104: Request processed in 50us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239688.462853:0:4986:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 197 00010000:00010000:3.0:1761239688.463045:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1761239688.463050:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463058:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fea013e5 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239688.463061:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463079:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239688.463085:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239688.463090:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239688.463134:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463140:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239688.463157:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463162:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000fea013e5/0x39427fb11b5ed106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a278e expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463174:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761239688.463176:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463180:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b72a1654 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239688.463182:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463186:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239688.463191:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239688.463195:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239688.463213:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463219:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239688.463224:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463228:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000b72a1654/0x39427fb11b5ed0ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2787 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239688.463239:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239688.463282:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239688.463283:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239688.465129:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1761239688.465160:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875506176:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761239688.465291:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1761239688.465303:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a69be96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875506240:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761239688.467813:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7c3db54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875506176:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761239688.470053:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a69be96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875506240:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1761239689.023469:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1761239689.216113:0:468:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761239689.216131:0:468:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1761239689.216134:0:468:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761239689.216136:0:468:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1761239689.216179:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875506368:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1761239689.216287:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1761239689.216294:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875506304:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1761239689.233200:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875506304:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1761239689.233223:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875506368:192.168.206.106@tcp:400:kworker/u8:4.0 10000000:01000000:0.0:1761239689.855360:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1761239689.855368:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 365 10000000:01000000:0.0:1761239689.855374:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1761239689.855432:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239689.855445:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239689.855456:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239689.855485:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506432:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761239689.855577:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009dca19b9 going to sleep for 43 seconds 00000100:00100000:0.0:1761239689.859526:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506432:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1761239689.859555:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239689.859568:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239689.859644:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506496:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761239689.859952:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009dca19b9 going to sleep for 43 seconds 00000100:00100000:0.0:1761239689.864723:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506496:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761239689.864781:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506560:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1761239689.864868:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009dca19b9 going to sleep for 43 seconds 00000100:00100000:0.0:1761239689.874850:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506560:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1761239689.877951:0:30604:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30604:1846792875506624:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761239689.878061:0:30604:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ce39ada5 going to sleep for 43 seconds 00000100:00100000:3.0:1761239689.885438:0:30604:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30604:1846792875506624:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761239689.885487:0:30604:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1761239689.885500:0:30604:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761239689.885502:0:30604:0:(obd_config.c:1460:class_process_config()) marker 239 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1761239689.885508:0:30604:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:3.0:1761239689.885511:0:30604:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1761239689.885565:0:30604:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30604:1846792875506688:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761239689.885638:0:30604:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ce39ada5 going to sleep for 43 seconds 00000100:00100000:3.0:1761239689.889236:0:30604:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30604:1846792875506688:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761239689.889327:0:30604:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1761239689.889335:0:30604:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761239689.889338:0:30604:0:(obd_config.c:1460:class_process_config()) marker 239 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1761239689.889341:0:30604:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 368 count 360 00000020:01000000:0.0:1761239689.889676:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 365-367 (rc=0) 10000000:01000000:0.0:1761239689.889697:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1761239689.889704:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239689.889715:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1761239689.889725:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1761239689.889727:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:0.0:1761239689.889730:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1761239689.889759:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239689.889777:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239689.889786:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239689.889806:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506752:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761239689.889890:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009dca19b9 going to sleep for 43 seconds 00000100:00100000:0.0:1761239689.893316:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506752:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1761239689.893346:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239689.893358:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239689.893442:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506816:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761239689.893502:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009dca19b9 going to sleep for 43 seconds 00000100:00100000:0.0:1761239689.896216:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875506816:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1761239689.896344:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1761239689.896352:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239689.896363:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239690.047490:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239691.071481:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239692.095447:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239693.119458:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1761239693.825831:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761239693.826100:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761239693.826211:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884135936 00000100:00100000:0.0:1761239693.826292:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884136000 00000100:00100000:0.0:1761239693.826305:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 198 00000100:00100000:0.0:1761239693.826311:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000790c1d3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30509:x1846792884135936:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761239693.826326:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239693.826419:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761239693.826424:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000790c1d3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30509:x1846792884135936:12345-192.168.206.106@tcp:104: Request processed in 114us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239693.826431:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 198 00000100:00100000:0.0:1761239693.826446:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 199 00000100:00100000:0.0:1761239693.826449:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009675c130 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:30509:x1846792884136000:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761239693.826455:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239693.826486:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1761239693.826490:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009675c130 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:30509:x1846792884136000:12345-192.168.206.106@tcp:104: Request processed in 40us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239693.826495:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 199 00010000:00010000:3.0:1761239693.826653:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1761239693.826657:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826664:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000560df5e0 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239693.826667:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826674:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239693.826679:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239693.826684:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239693.826722:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826727:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239693.826746:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826752:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000560df5e0/0x39427fb11b5ed114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a27a3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826764:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761239693.826766:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826770:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000080e7fb92 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239693.826772:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826797:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239693.826802:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239693.826805:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239693.826816:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826821:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239693.826825:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826829:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000080e7fb92/0x39427fb11b5ed10d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a279c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239693.826838:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239693.826839:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239693.826840:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761239693.826855:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875506880:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1761239693.826902:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1761239693.826908:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875506944:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1761239693.827230:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761239693.832514:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875506944:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1761239693.832543:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875506880:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1761239694.144673:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1761239694.337499:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1761239694.337505:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:3.0:1761239694.337520:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1761239694.337522:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1761239694.337556:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875507072:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1761239694.339057:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1761239694.339071:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875507008:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1761239694.346061:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875507072:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1761239694.352317:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875507008:192.168.206.106@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1761239695.176123:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1761239695.809483:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1761239695.809491:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 368 10000000:01000000:0.0:1761239695.809497:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1761239695.809541:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239695.809552:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239695.809562:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239695.809601:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507136:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761239695.810066:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000003da0712e going to sleep for 43 seconds 00000100:00100000:2.0:1761239695.814423:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507136:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761239695.814456:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239695.814468:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761239695.814544:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507200:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761239695.816020:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000081a166dd going to sleep for 43 seconds 00000100:00100000:2.0:1761239695.819287:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507200:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761239695.819356:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507264:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761239695.819475:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000081a166dd going to sleep for 43 seconds 00000100:00100000:2.0:1761239695.822514:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507264:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761239695.823356:0:30667:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30667:1846792875507328:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761239695.823485:0:30667:0:(client.c:2500:ptlrpc_set_wait()) set 000000007eee52f6 going to sleep for 43 seconds 00000100:00100000:2.0:1761239695.833930:0:30667:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30667:1846792875507328:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761239695.833993:0:30667:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1761239695.834009:0:30667:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761239695.834011:0:30667:0:(obd_config.c:1460:class_process_config()) marker 241 (0x1) lustre-clilov rem lustre.testpool2.lustre-OST0001_UUID 00000020:01000000:2.0:1761239695.834019:0:30667:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:2.0:1761239695.834022:0:30667:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1761239695.834037:0:30667:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool2 00000100:00100000:2.0:1761239695.834084:0:30667:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30667:1846792875507392:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761239695.834195:0:30667:0:(client.c:2500:ptlrpc_set_wait()) set 000000007eee52f6 going to sleep for 43 seconds 00000100:00100000:2.0:1761239695.861165:0:30667:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30667:1846792875507392:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761239695.861230:0:30667:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1761239695.861253:0:30667:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761239695.861256:0:30667:0:(obd_config.c:1460:class_process_config()) marker 241 (0x2) lustre-clilov rem lustre.testpool2.lustre-OST0001_UUID 00000040:00080000:2.0:1761239695.861261:0:30667:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 371 count 363 00000020:01000000:0.0:1761239695.862477:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 368-370 (rc=0) 10000000:01000000:0.0:1761239695.862515:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1761239695.862526:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239695.862542:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1761239695.862553:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1761239695.862556:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:0.0:1761239695.862560:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1761239695.862606:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239695.862613:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239695.862624:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239695.862653:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000326592a6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507456:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761239695.863034:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000006693800b going to sleep for 43 seconds 00000100:00100000:2.0:1761239695.873945:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000326592a6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507456:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761239695.873991:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239695.874009:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761239695.874140:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507520:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761239695.874238:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000007eee52f6 going to sleep for 43 seconds 00000100:00100000:0.0:1761239695.886445:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0080a0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507520:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1761239695.886497:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1761239695.886505:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239695.886529:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239696.191493:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239697.215936:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1761239697.268302:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761239697.268355:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761239697.268425:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884138624 00000100:00100000:0.0:1761239697.268470:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884138688 00000100:00100000:0.0:1761239697.268485:0:4986:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 200 00000100:00100000:0.0:1761239697.268491:0:4986:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056e82f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30618:x1846792884138624:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761239697.268506:0:4986:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239697.268777:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 201 00000100:00100000:1.0:1761239697.268783:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ddf6dab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30618:x1846792884138688:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761239697.268790:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239697.268933:0:4986:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1761239697.268940:0:4986:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056e82f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:30618:x1846792884138624:12345-192.168.206.106@tcp:104: Request processed in 448us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239697.268948:0:4986:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 200 00010000:00010000:3.0:1761239697.269029:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1761239697.269034:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269042:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000093db3b2d already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239697.269045:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269052:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239697.269058:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239697.269063:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239697.269106:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269113:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239697.269146:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269152:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000093db3b2d/0x39427fb11b5ed122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a287c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269167:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761239697.269169:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269174:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000097f1994b already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239697.269176:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269181:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239697.269190:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239697.269194:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239697.269206:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269211:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239697.269216:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269220:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000097f1994b/0x39427fb11b5ed11b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2875 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239697.269231:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239697.269232:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239697.269238:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761239697.269308:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875507584:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1761239697.269368:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1761239697.269374:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875507648:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1761239697.269801:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1761239697.269830:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1761239697.269837:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ddf6dab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:30618:x1846792884138688:12345-192.168.206.106@tcp:104: Request processed in 1053us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1761239697.269844:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 201 00000100:00100000:3.0:1761239697.275284:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875507648:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1761239697.275424:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875507584:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1761239698.241642:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1761239699.135558:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1761239699.135569:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 371 10000000:01000000:2.0:1761239699.135575:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1761239699.135623:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239699.135635:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239699.135644:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761239699.135669:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507712:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1761239699.135762:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fd717835 going to sleep for 43 seconds 00000100:00100000:2.0:1761239699.145932:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507712:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761239699.145961:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239699.145973:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761239699.146045:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507776:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761239699.146215:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fd717835 going to sleep for 43 seconds 00000100:00100000:2.0:1761239699.148629:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507776:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761239699.148781:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507840:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761239699.151589:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fd717835 going to sleep for 43 seconds 00000100:00100000:2.0:1761239699.158426:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875507840:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761239699.161672:0:30685:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30685:1846792875507904:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761239699.161775:0:30685:0:(client.c:2500:ptlrpc_set_wait()) set 000000003f5137f9 going to sleep for 43 seconds 00000100:00100000:2.0:1761239699.171319:0:30685:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30685:1846792875507904:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761239699.171375:0:30685:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1761239699.171386:0:30685:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761239699.171389:0:30685:0:(obd_config.c:1460:class_process_config()) marker 243 (0x1) lustre-clilov del lustre.testpool2 00000020:01000000:2.0:1761239699.171394:0:30685:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:2.0:1761239699.171397:0:30685:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1761239699.171456:0:30685:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30685:1846792875507968:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761239699.171541:0:30685:0:(client.c:2500:ptlrpc_set_wait()) set 000000003f5137f9 going to sleep for 43 seconds 00000100:00100000:2.0:1761239699.175608:0:30685:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:30685:1846792875507968:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761239699.175662:0:30685:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1761239699.175672:0:30685:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761239699.175674:0:30685:0:(obd_config.c:1460:class_process_config()) marker 243 (0x2) lustre-clilov del lustre.testpool2 00000040:00080000:2.0:1761239699.175679:0:30685:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 374 count 366 00000020:01000000:0.0:1761239699.176273:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 371-373 (rc=0) 10000000:01000000:0.0:1761239699.176298:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1761239699.176305:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239699.176317:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1761239699.176328:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1761239699.176330:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:0.0:1761239699.176333:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1761239699.176378:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239699.176395:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239699.176404:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239699.176423:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875508032:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761239699.176498:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000041ac09f5 going to sleep for 43 seconds 00000100:00100000:1.0:1761239699.183015:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875508032:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1761239699.183043:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239699.183055:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239699.183128:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db276e82 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875508096:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1761239699.183200:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bd7ba66b going to sleep for 43 seconds 00000100:00100000:1.0:1761239699.189416:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db276e82 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875508096:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1761239699.189465:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1761239699.189471:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239699.189495:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239699.265546:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1761239699.455483:0:468:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761239699.455490:0:468:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761239699.455492:0:468:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761239699.455495:0:468:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1761239699.455508:0:2216:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1761239699.455526:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db276e82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792875508160:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1761239699.462973:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db276e82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792875508160:192.168.206.106@tcp:400:kworker/u8:4.0 00000080:00200000:3.0:1761239700.219434:0:29852:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:3.0:1761239700.219458:0:29852:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1761239700.219474:0:29852:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 00000000753932f7 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:3.0:1761239700.219521:0:29852:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.219531:0:29852:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.219541:0:29852:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761239700.219567:0:29852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job bash:4ffd2023-cacd-4e39-8a6e-05d927860e2a:29852:1846792875508224:192.168.206.106@tcp:101:bash.0 00000100:00100000:3.0:1761239700.219649:0:29852:0:(client.c:2500:ptlrpc_set_wait()) set 000000006f2ed397 going to sleep for 43 seconds 00000100:00100000:3.0:1761239700.221817:0:29852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job bash:4ffd2023-cacd-4e39-8a6e-05d927860e2a:29852:1846792875508224:192.168.206.106@tcp:101:bash.0 00010000:00010000:3.0:1761239700.221839:0:29852:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.221867:0:29852:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.221878:0:29852:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.221888:0:29852:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.221898:0:29852:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.221904:0:29852:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.221910:0:29852:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1761239700.221921:0:29852:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@000000001460bb96 x1846792875508224/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 576/688 e 0 to 0 dl 1761239744 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:3.0:1761239700.221978:0:29852:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.221995:0:29852:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 00000000753932f7 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1761239700.222041:0:29852:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 10752 00000080:00010000:3.0:1761239700.222048:0:29852:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ed137 00000080:00010000:3.0:1761239700.222054:0:29852:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:3.0:1761239700.222056:0:29852:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ed137 from it 00000000daf86ff8 00010000:00010000:3.0:1761239700.222064:0:29852:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239700.222071:0:29852:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1761239700.237737:0:30714:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:0.0:1761239700.237760:0:30714:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1761239700.237775:0:30714:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239700.237787:0:30714:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1761239700.237795:0:30714:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:0.0:1761239700.237798:0:30714:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:0.0:1761239700.237803:0:30714:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 0000000068b3ba57 00010000:00010000:0.0:1761239700.237805:0:30714:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239700.237812:0:30714:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1761239700.237824:0:30714:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 44 00000080:00200000:0.0:1761239700.237837:0:30714:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), flags 320400 00000080:00200000:0.0:1761239700.237851:0:30714:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), cmd=0x4008669a 00010000:00010000:0.0:1761239700.237863:0:30714:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239700.237876:0:30714:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239700.237914:0:30714:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239700.237920:0:30714:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1761239700.237921:0:30714:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b72a1654/0x39427fb11b5ed137 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x998704a8c64a2901 expref: -99 pid: 29852 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1761239700.237935:0:30714:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1761239700.237945:0:30714:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a56a7217 x1846792875508352/t0(0) o36->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1761239700.237965:0:30714:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a56a7217 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:30714:1846792875508352:192.168.206.106@tcp:36:lfs.0 00000100:00100000:0.0:1761239700.238036:0:30714:0:(client.c:2500:ptlrpc_set_wait()) set 000000006693800b going to sleep for 43 seconds 00000100:00100000:2.0:1761239700.242285:0:30714:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a56a7217 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:30714:1846792875508352:192.168.206.106@tcp:36:lfs.0 00000080:00200000:2.0:1761239700.242337:0:30714:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a) 00010000:00010000:3.0:1761239700.287442:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239701.312318:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239702.336784:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239703.360479:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239704.383356:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1761239704.577278:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761239704.577285:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1761239704.577287:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761239704.577289:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1761239704.577354:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875508416:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1761239704.577434:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037699750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875508480:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1761239704.594331:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037699750 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875508480:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1761239704.594415:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875508416:192.168.206.106@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1761239705.411174:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1761239706.435590:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1761239706.690162:0:30967:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1761239706.690167:0:30967:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 12: OST Pool Membership ================ 13:15:05 (1761239705) 00010000:00010000:2.0:1761239707.460890:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:2.0:1761239707.781522:0:31103:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1761239707.781528:0:31103:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: ost-pools test_12 needs >=3 OSTs 00010000:00010000:3.0:1761239708.480380:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:2.0:1761239709.311563:0:31257:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1761239709.311568:0:31257:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 13: Striping characteristics in a pool ========================================================== 13:15:08 (1761239708) 00010000:00010000:2.0:1761239709.504783:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1761239709.695663:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1761239709.695669:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:3.0:1761239709.695672:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1761239709.695675:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1761239709.698333:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875508544:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1761239709.698433:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1761239709.698441:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792875508608:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1761239709.707001:0:2218:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff969f82c5a000: committing for last_committed 4294967424 gen 1 00000100:00100000:3.0:1761239709.707029:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792875508608:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1761239709.707043:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875508544:192.168.206.106@tcp:400:kworker/u8:1.0 00000400:00000080:0.0:1761239710.457591:0:31393:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1761239710.457597:0:31393:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: ost-pools test_13 needs >= 3 OSTs 00010000:00010000:2.0:1761239710.527425:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239711.551891:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1761239712.040543:0:31546:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1761239712.040548:0:31546:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 14: Round robin and QOS striping within a pool ========================================================== 13:15:10 (1761239710) 00010000:00010000:3.0:1761239712.576615:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:2.0:1761239713.279608:0:31682:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1761239713.279613:0:31682:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: ost-pools test_14 needs >= 3 OSTs 00010000:00010000:3.0:1761239713.600418:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239714.627591:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:2.0:1761239714.684333:0:31835:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1761239714.684338:0:31835:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 15: One directory per OST/pool ========= 13:15:13 (1761239713) 00000100:00080000:1.0:1761239714.823594:0:8:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761239714.823602:0:8:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761239714.823604:0:8:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761239714.823607:0:8:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1761239714.823687:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067ba5243 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792875508672:192.168.206.106@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1761239714.823792:0:2216:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1761239714.823802:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000676d9876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792875508736:192.168.206.106@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1761239714.827801:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000676d9876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792875508736:192.168.206.106@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1761239714.829311:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067ba5243 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792875508672:192.168.206.106@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1761239715.526353:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761239715.526415:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:3.0:1761239715.526549:0:4989:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884142848 00000100:00100000:3.0:1761239715.527051:0:4989:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 9 00000100:00100000:3.0:1761239715.527061:0:4989:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000676d9876 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:31530:x1846792884142848:12345-192.168.206.106@tcp:104: 00010000:00010000:3.0:1761239715.527079:0:4989:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239715.527177:0:18415:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1761239715.527188:0:4989:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1761239715.527196:0:4989:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000676d9876 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:31530:x1846792884142848:12345-192.168.206.106@tcp:104: Request processed in 134us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239715.527203:0:18415:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884142784 00000100:00100000:3.0:1761239715.527205:0:4989:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 9 00010000:00010000:3.0:1761239715.527301:0:4996:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761239715.527308:0:4996:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.527315:0:4996:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a2a08e66 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239715.527318:0:4996:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.527326:0:4996:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239715.527334:0:4996:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239715.527339:0:4996:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239715.527374:0:4996:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.527392:0:4996:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239715.527412:0:4996:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.527418:0:4996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000a2a08e66/0x39427fb11b5ed129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a28ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.527432:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239715.527434:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239715.527435:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761239715.527452:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875508800:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1761239715.527703:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 202 00000100:00100000:0.0:1761239715.527714:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055c4a7ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:31530:x1846792884142784:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761239715.527729:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239715.527958:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761239715.527965:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055c4a7ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:31530:x1846792884142784:12345-192.168.206.106@tcp:104: Request processed in 252us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1761239715.527972:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 202 00010000:00010000:3.0:1761239715.529555:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761239715.529565:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.529579:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004820aa61 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239715.529582:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.529592:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239715.529598:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239715.529602:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239715.531320:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.531340:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1761239715.531432:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875508864:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1761239715.532172:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.532182:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 000000004820aa61/0x39427fb11b5ed130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a28f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239715.532205:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239715.532207:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239715.532209:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761239715.535213:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875508800:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1761239715.539975:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da14fe41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875508864:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1761239715.647703:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239716.672961:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1761239717.312871:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1761239717.312883:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 374 10000000:01000000:2.0:1761239717.312890:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1761239717.312953:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239717.312991:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239717.313004:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761239717.313867:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875508928:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1761239717.313988:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c59b124a going to sleep for 43 seconds 00000100:00100000:2.0:1761239717.327809:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875508928:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761239717.327848:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239717.327865:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761239717.327971:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875508992:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761239717.328058:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c59b124a going to sleep for 43 seconds 00000100:00100000:2.0:1761239717.335734:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875508992:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761239717.335816:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509056:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761239717.335938:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c59b124a going to sleep for 43 seconds 00000100:00100000:2.0:1761239717.339837:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509056:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761239717.343925:0:31858:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:31858:1846792875509120:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761239717.344049:0:31858:0:(client.c:2500:ptlrpc_set_wait()) set 000000006e998639 going to sleep for 43 seconds 00000100:00100000:2.0:1761239717.351632:0:31858:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:31858:1846792875509120:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761239717.351699:0:31858:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1761239717.351713:0:31858:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761239717.351715:0:31858:0:(obd_config.c:1460:class_process_config()) marker 245 (0x1) lustre-clilov new lustre.testpool0 00000020:01000000:2.0:1761239717.351721:0:31858:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:2.0:1761239717.351723:0:31858:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1761239717.351767:0:31858:0:(lov_pool.c:313:lov_pool_new()) testpool0 is pool #1 00000100:00100000:2.0:1761239717.351815:0:31858:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:31858:1846792875509184:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761239717.351925:0:31858:0:(client.c:2500:ptlrpc_set_wait()) set 000000004b4731bb going to sleep for 43 seconds 00000100:00100000:2.0:1761239717.356782:0:31858:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:31858:1846792875509184:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761239717.357607:0:31858:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1761239717.357621:0:31858:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761239717.357623:0:31858:0:(obd_config.c:1460:class_process_config()) marker 245 (0x2) lustre-clilov new lustre.testpool0 00000040:00080000:2.0:1761239717.357628:0:31858:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 377 count 369 00000020:01000000:1.0:1761239717.359076:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 374-376 (rc=0) 10000000:01000000:1.0:1761239717.359117:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1761239717.359127:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239717.359142:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1761239717.359155:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1761239717.359157:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:1.0:1761239717.359161:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1761239717.359209:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239717.361102:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239717.361117:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239717.361158:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f0a0f67 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509248:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761239717.361382:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000062bb7ce5 going to sleep for 43 seconds 00000100:00100000:3.0:1761239717.368624:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f0a0f67 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509248:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1761239717.368672:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239717.368688:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761239717.368797:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509312:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1761239717.370842:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a1caf66e going to sleep for 43 seconds 00000100:00100000:2.0:1761239717.372619:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001460bb96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509312:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1761239717.372689:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1761239717.372701:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239717.372712:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239717.695456:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239718.720295:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1761239719.194038:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761239719.195535:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761239719.195568:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884146048 00000100:00100000:1.0:1761239719.195639:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 203 00000100:00100000:1.0:1761239719.195646:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056e82f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:31635:x1846792884146048:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761239719.195669:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239719.195773:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1761239719.195779:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056e82f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:31635:x1846792884146048:12345-192.168.206.106@tcp:104: Request processed in 133us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1761239719.195806:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 203 00010000:00010000:3.0:1761239719.195837:0:4996:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761239719.195845:0:4996:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.195853:0:4996:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000039cfbb39 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239719.195857:0:4996:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.195873:0:4996:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239719.195880:0:4996:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239719.195886:0:4996:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239719.195931:0:4996:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.195938:0:4996:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239719.195962:0:4996:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.195969:0:4996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a297f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.195986:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239719.195988:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239719.195989:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761239719.196011:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003252b671 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875509376:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1761239719.196330:0:18415:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884146112 00000100:00100000:1.0:1761239719.199354:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 204 00000100:00100000:1.0:1761239719.199368:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ddf6dab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:31635:x1846792884146112:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761239719.199388:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239719.199495:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1761239719.199500:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ddf6dab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:31635:x1846792884146112:12345-192.168.206.106@tcp:104: Request processed in 134us (3974us total) trans 0 rc 0/0 00000100:00100000:1.0:1761239719.199507:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 204 00010000:00010000:3.0:1761239719.199783:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761239719.199790:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.199799:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b65063bf already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761239719.199802:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.199810:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761239719.199843:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761239719.199849:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761239719.199890:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.199896:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761239719.199918:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.199924:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000b65063bf/0x39427fb11b5ed13e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64a2978 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239719.199942:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239719.199944:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239719.199945:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761239719.199962:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1761239719.199981:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875509440:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1761239719.200816:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003252b671 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875509376:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1761239719.205520:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792875509440:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1761239719.743540:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1761239719.936143:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1761239719.936151:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:3.0:1761239719.936154:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1761239719.936157:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1761239719.936448:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1761239719.936476:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875509504:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1761239719.944935:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875509504:192.168.206.106@tcp:400:kworker/u8:2.0 10000000:01000000:1.0:1761239720.450477:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1761239720.450486:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 377 10000000:01000000:1.0:1761239720.450494:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1761239720.450554:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000b700fead/0x39427fb11b5ed14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239720.450568:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000b700fead/0x39427fb11b5ed14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239720.450578:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000b700fead/0x39427fb11b5ed14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239720.450613:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509568:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761239720.450718:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:1.0:1761239720.461955:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509568:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1761239720.461994:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000b700fead/0x39427fb11b5ed14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a298d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239720.462021:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000b700fead/0x39427fb11b5ed14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a298d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239720.462122:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509632:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1761239720.467314:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:1.0:1761239720.478022:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509632:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1761239720.478105:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509696:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1761239720.478219:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:1.0:1761239720.483308:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509696:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1761239720.483917:0:31901:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:31901:1846792875509760:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761239720.484014:0:31901:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e4deafa6 going to sleep for 43 seconds 00000100:00100000:3.0:1761239720.491384:0:31901:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:31901:1846792875509760:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761239720.491460:0:31901:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1761239720.491478:0:31901:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761239720.491480:0:31901:0:(obd_config.c:1460:class_process_config()) marker 247 (0x1) lustre-clilov add lustre.testpool0.lustre-OST0000_UUID 00000020:01000000:3.0:1761239720.491488:0:31901:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:3.0:1761239720.491491:0:31901:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1761239720.491509:0:31901:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool0 as member 1 00000100:00100000:3.0:1761239720.491562:0:31901:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:31901:1846792875509824:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761239720.491676:0:31901:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e4deafa6 going to sleep for 43 seconds 00000100:00100000:3.0:1761239720.500840:0:31901:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:31901:1846792875509824:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761239720.500927:0:31901:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1761239720.500941:0:31901:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761239720.500944:0:31901:0:(obd_config.c:1460:class_process_config()) marker 247 (0x2) lustre-clilov add lustre.testpool0.lustre-OST0000_UUID 00000040:00080000:3.0:1761239720.500947:0:31901:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 380 count 372 00000020:01000000:1.0:1761239720.503101:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 377-379 (rc=0) 10000000:01000000:1.0:1761239720.503148:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1761239720.503159:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000b700fead/0x39427fb11b5ed14c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a298d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239720.503176:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000b700fead/0x39427fb11b5ed14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a298d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1761239720.503188:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1761239720.503190:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:1.0:1761239720.503193:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1761239720.503304:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239720.503313:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239720.503324:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239720.503380:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509888:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761239720.503485:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:1.0:1761239720.518014:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509888:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1761239720.518054:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed153 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2994 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239720.518069:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed153 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64a2994 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239720.518174:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509952:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1761239720.518287:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:1.0:1761239720.530755:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792875509952:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1761239720.530823:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1761239720.530835:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed153 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2994 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239720.530848:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000039cfbb39/0x39427fb11b5ed153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64a2994 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239720.770114:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239721.797308:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1761239722.095782:0:31921:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761239722.095812:0:31921:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761239722.095834:0:31921:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.095855:0:31921:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761239722.095881:0:31921:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761239722.095886:0:31921:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761239722.095897:0:31921:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000dbeab57f 00010000:00010000:1.0:1761239722.095900:0:31921:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.095908:0:31921:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761239722.095928:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 101 00000080:00200000:1.0:1761239722.095938:0:31921:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761239722.095943:0:31921:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761239722.095948:0:31921:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.095957:0:31921:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761239722.095963:0:31921:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761239722.095965:0:31921:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761239722.095968:0:31921:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000c2b5dde5 00010000:00010000:1.0:1761239722.095969:0:31921:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.095975:0:31921:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761239722.095982:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:1.0:1761239722.096003:0:31921:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), flags=1536 00000080:00200000:1.0:1761239722.096008:0:31921:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761239722.096012:0:31921:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761239722.096018:0:31921:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.096024:0:31921:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761239722.096031:0:31921:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761239722.096033:0:31921:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761239722.096035:0:31921:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 000000000b60f462 00010000:00010000:1.0:1761239722.096037:0:31921:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.096043:0:31921:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761239722.096051:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 3 00000080:00200000:1.0:1761239722.096055:0:31921:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761239722.096059:0:31921:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761239722.096064:0:31921:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.096070:0:31921:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761239722.096076:0:31921:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761239722.096077:0:31921:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761239722.096087:0:31921:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 0000000052fced04 00010000:00010000:1.0:1761239722.096089:0:31921:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.096096:0:31921:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761239722.096104:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 3 00000080:00200000:1.0:1761239722.096109:0:31921:0:(namei.c:1898:ll_mkdir()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a) 00800000:00000004:1.0:1761239722.096132:0:31921:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff969f82c5a000: age 130, max_age 0 00000100:00100000:1.0:1761239722.096285:0:2215:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1761239722.096316:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792875510016:192.168.206.106@tcp:41:mkdir.0 00000020:00100000:1.0:1761239722.096464:0:31921:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1761239722.096472:0:31921:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ff3fe92e x1846792875510144/t0(0) o36->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1761239722.096489:0:31921:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ff3fe92e pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31921:1846792875510144:192.168.206.106@tcp:36:mkdir.0 00000100:00100000:1.0:1761239722.096506:0:31921:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:0.0:1761239722.099359:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f70796c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792875510016:192.168.206.106@tcp:41:mkdir.0 00000100:00100000:1.0:1761239722.101811:0:31921:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ff3fe92e pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31921:1846792875510144:192.168.206.106@tcp:36:mkdir.0 00000080:00200000:1.0:1761239722.101870:0:31921:0:(llite_lib.c:2833:ll_read_inode2()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b) 00000080:00200000:1.0:1761239722.101878:0:31921:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0x21:0x0], updating i_size 512 00000080:00200000:1.0:1761239722.101952:0:31921:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761239722.101969:0:31921:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761239722.101988:0:31921:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.102002:0:31921:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761239722.102032:0:31921:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761239722.102036:0:31921:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761239722.102044:0:31921:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000670f5b2c 00010000:00010000:1.0:1761239722.102046:0:31921:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.102054:0:31921:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761239722.102069:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:1.0:1761239722.102086:0:31921:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), file 000000009f9d5ef3, open_flags 38900, mode 0 opened 0 00000080:00200000:1.0:1761239722.102095:0:31921:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), intent=open 00000002:00010000:1.0:1761239722.102107:0:31921:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d15.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0704401 00010000:00010000:1.0:1761239722.102161:0:31921:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.102169:0:31921:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1761239722.102180:0:31921:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1761239722.102188:0:31921:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c903b4d9 x1846792875510272/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1761239722.102197:0:31921:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239722.102218:0:31921:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c903b4d9 pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31921:1846792875510272:192.168.206.106@tcp:101:mkdir.0 00000100:00100000:1.0:1761239722.102765:0:31921:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:1.0:1761239722.108587:0:31921:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c903b4d9 pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31921:1846792875510272:192.168.206.106@tcp:101:mkdir.0 00010000:00010000:1.0:1761239722.108617:0:31921:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108634:0:31921:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108640:0:31921:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108647:0:31921:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108656:0:31921:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108662:0:31921:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007c89eebc already unused, calling callback (0000000089d89e79) 00010000:00010000:1.0:1761239722.108667:0:31921:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108674:0:31921:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108680:0:31921:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108688:0:31921:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1761239722.108695:0:31921:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.108728:0:31921:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed15a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31921 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1761239722.108748:0:31921:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@00000000c903b4d9 x1846792875510272/t4294967426(4294967426) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000002:00100000:1.0:1761239722.108762:0:31921:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000c903b4d9 x1846792875510272/t4294967426(4294967426) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000080:00200000:1.0:1761239722.108802:0:31921:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0x21:0x0], updating i_size 512 00000080:00200000:1.0:1761239722.108805:0:31921:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x21:0x0](00000000b0d0752b): rc = 0 00000080:00010000:1.0:1761239722.108812:0:31921:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0x21:0x0](00000000b0d0752b) for lock 0x0 00000080:00200000:1.0:1761239722.108890:0:31921:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), flags 704400 00000002:00100000:1.0:1761239722.108909:0:31921:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000c903b4d9 x1846792875510272/t4294967426(4294967426) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000080:00200000:1.0:1761239722.109066:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 44 00000080:00200000:1.0:1761239722.109097:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 101 00000080:00200000:1.0:1761239722.109115:0:31921:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b) 00000002:00100000:1.0:1761239722.109149:0:31921:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@00000000c903b4d9 x1846792875510272/t4294967426(4294967426) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761239766 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'mkdir.0' 00000020:00100000:1.0:1761239722.109179:0:31921:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1761239722.109183:0:31921:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001b998c4d x1846792875510400/t0(0) o35->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1761239722.109205:0:31921:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b998c4d pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31921:1846792875510400:192.168.206.106@tcp:35:mkdir.0 00000100:00100000:1.0:1761239722.110847:0:31921:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 6 seconds 00000100:00100000:1.0:1761239722.118051:0:31921:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b998c4d pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31921:1846792875510400:192.168.206.106@tcp:35:mkdir.0 00000002:00100000:1.0:1761239722.118117:0:31921:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@00000000c903b4d9 x1846792875510272/t4294967426(4294967426) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761239766 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'mkdir.0' 00000080:00200000:1.0:1761239722.118188:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 1 00000080:00200000:1.0:1761239722.118209:0:31921:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), flags=1536 00000080:00200000:1.0:1761239722.118213:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 3 00000080:00200000:1.0:1761239722.118218:0:31921:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 3 00000080:00200000:1.0:1761239722.118221:0:31921:0:(namei.c:1898:ll_mkdir()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b) 00000020:00100000:1.0:1761239722.118385:0:31921:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1761239722.118392:0:31921:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001b998c4d x1846792875510528/t0(0) o36->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1761239722.118429:0:31921:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b998c4d pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31921:1846792875510528:192.168.206.106@tcp:36:mkdir.0 00000100:00100000:1.0:1761239722.119635:0:31921:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:1.0:1761239722.126709:0:31921:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b998c4d pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31921:1846792875510528:192.168.206.106@tcp:36:mkdir.0 00000080:00200000:0.0:1761239722.127546:0:31921:0:(llite_lib.c:2833:ll_read_inode2()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100) 00000080:00200000:0.0:1761239722.127558:0:31921:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:0.0:1761239722.142920:0:31922:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:0.0:1761239722.142955:0:31922:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1761239722.142977:0:31922:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.142993:0:31922:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1761239722.143005:0:31922:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:0.0:1761239722.143008:0:31922:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:0.0:1761239722.143016:0:31922:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000a9660230 00010000:00010000:0.0:1761239722.143019:0:31922:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.143038:0:31922:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1761239722.143055:0:31922:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:0.0:1761239722.143070:0:31922:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), flags=25 00000080:00200000:0.0:1761239722.143076:0:31922:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), intent=0 00000002:00010000:0.0:1761239722.143090:0:31922:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d15.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1761239722.143147:0:31922:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.143155:0:31922:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.143166:0:31922:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239722.143197:0:31922:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f7b64c2 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875510592:192.168.206.106@tcp:101:lfs.0 00000100:00100000:0.0:1761239722.143352:0:31922:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e1168f5e going to sleep for 43 seconds 00000100:00100000:2.0:1761239722.152196:0:31922:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f7b64c2 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875510592:192.168.206.106@tcp:101:lfs.0 00010000:00010000:2.0:1761239722.152239:0:31922:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152303:0:31922:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152332:0:31922:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152345:0:31922:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152355:0:31922:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152367:0:31922:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152375:0:31922:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152381:0:31922:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1761239722.152390:0:31922:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@000000004f7b64c2 x1846792875510592/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 584/640 e 0 to 0 dl 1761239766 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1761239722.152401:0:31922:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152410:0:31922:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 00000000753932f7 type 13 mode 4 res 8589935617/33 (0 0) 00000080:00200000:2.0:1761239722.152442:0:31922:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0x21:0x0], updating i_size 512 00000080:00200000:2.0:1761239722.152446:0:31922:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x21:0x0](00000000b0d0752b): rc = 0 00000080:00010000:2.0:1761239722.152456:0:31922:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0x21:0x0](00000000b0d0752b) for lock 0x39427fb11b5ed161 00000080:00010000:2.0:1761239722.152468:0:31922:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x21:0x0](00000000b0d0752b) 00000080:00010000:2.0:1761239722.152481:0:31922:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ed161 from it 00000000d52b8397 00010000:00010000:2.0:1761239722.152483:0:31922:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152491:0:31922:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65b7aa5/0x39427fb11b5ed161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2a4a expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1761239722.152533:0:31922:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 1 00000080:00200000:2.0:1761239722.152555:0:31922:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 3 00000080:00200000:2.0:1761239722.152559:0:31922:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), file 00000000837ffd1a, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1761239722.152570:0:31922:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), intent=open|creat 00000002:00010000:2.0:1761239722.152594:0:31922:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x200000401:0x23:0x0]) in obj [0x200000401:0x21:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1761239722.152654:0:31922:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.152661:0:31922:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1761239722.152673:0:31922:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1761239722.152679:0:31922:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001ae8158e x1846792875510720/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1761239722.152687:0:31922:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761239722.152709:0:31922:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875510720:192.168.206.106@tcp:101:lfs.0 00000100:00100000:2.0:1761239722.152922:0:31922:0:(client.c:2500:ptlrpc_set_wait()) set 000000004b4731bb going to sleep for 43 seconds 00000100:00100000:2.0:1761239722.164080:0:31922:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875510720:192.168.206.106@tcp:101:lfs.0 00010000:00010000:2.0:1761239722.164111:0:31922:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164150:0:31922:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164157:0:31922:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164165:0:31922:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164174:0:31922:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164180:0:31922:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b65063bf already unused, calling callback (0000000089d89e79) 00010000:00010000:2.0:1761239722.164184:0:31922:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164192:0:31922:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164200:0:31922:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 5/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164209:0:31922:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1761239722.164610:0:31922:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164622:0:31922:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000b65063bf/0x39427fb11b5ed168 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1761239722.164658:0:31922:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@000000001ae8158e x1846792875510720/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/600 e 0 to 0 dl 1761239766 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1761239722.164864:0:31922:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:2.0:1761239722.164882:0:31922:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1761239722.164898:0:31922:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164909:0:31922:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1761239722.164919:0:31922:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:2.0:1761239722.164923:0:31922:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:2.0:1761239722.164929:0:31922:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000a9660230 00010000:00010000:2.0:1761239722.164932:0:31922:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.164939:0:31922:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1761239722.164954:0:31922:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:2.0:1761239722.164962:0:31922:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d15.ost-pools, flags=27 00000080:00200000:2.0:1761239722.164966:0:31922:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 1 00000080:00200000:2.0:1761239722.164978:0:31922:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), file 000000000ac301c0, open_flags 1a100, mode 0 opened 0 00000080:00200000:2.0:1761239722.164985:0:31922:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), intent=open 00000002:00010000:2.0:1761239722.164999:0:31922:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x0:0x0:0x0]) in obj [0x200000401:0x21:0x0], intent: open flags 0320401 00010000:00010000:2.0:1761239722.165053:0:31922:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.165067:0:31922:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1761239722.165082:0:31922:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1761239722.165088:0:31922:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001ae8158e x1846792875510848/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1761239722.165097:0:31922:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761239722.165122:0:31922:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875510848:192.168.206.106@tcp:101:lfs.0 00000100:00100000:2.0:1761239722.166424:0:31922:0:(client.c:2500:ptlrpc_set_wait()) set 000000004b4731bb going to sleep for 43 seconds 00000100:00100000:2.0:1761239722.171932:0:31922:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875510848:192.168.206.106@tcp:101:lfs.0 00010000:00010000:2.0:1761239722.171963:0:31922:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.171979:0:31922:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.171987:0:31922:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.171995:0:31922:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.172005:0:31922:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.172038:0:31922:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a2a08e66 already unused, calling callback (0000000089d89e79) 00010000:00010000:2.0:1761239722.172042:0:31922:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.172049:0:31922:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.172055:0:31922:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 5/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.172062:0:31922:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1761239722.172069:0:31922:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761239722.172075:0:31922:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a2a08e66/0x39427fb11b5ed16f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31922 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1761239722.172098:0:31922:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@000000001ae8158e x1846792875510848/t4294967429(4294967429) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1761239722.172112:0:31922:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@000000001ae8158e x1846792875510848/t4294967429(4294967429) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1761239722.172152:0:31922:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:2.0:1761239722.172156:0:31922:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x22:0x0](0000000057b83100): rc = 0 00000080:00010000:2.0:1761239722.172163:0:31922:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0x22:0x0](0000000057b83100) for lock 0x0 00000080:00200000:2.0:1761239722.172191:0:31922:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), flags 320400 00000002:00100000:2.0:1761239722.172211:0:31922:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@000000001ae8158e x1846792875510848/t4294967429(4294967429) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1761239722.172444:0:31922:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), inode mode 41ed mask 44 00000080:00200000:2.0:1761239722.172497:0:31922:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), cmd=0x4008669a 00000020:00100000:2.0:1761239722.172560:0:31922:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1761239722.172567:0:31922:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000058a60214 x1846792875510976/t0(0) o36->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1761239722.172590:0:31922:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000058a60214 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875510976:192.168.206.106@tcp:36:lfs.0 00000100:00100000:2.0:1761239722.172679:0:31922:0:(client.c:2500:ptlrpc_set_wait()) set 000000004b4731bb going to sleep for 43 seconds 00000100:00100000:2.0:1761239722.176726:0:31922:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000058a60214 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875510976:192.168.206.106@tcp:36:lfs.0 00000080:00200000:2.0:1761239722.176806:0:31922:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100) 00000002:00100000:2.0:1761239722.176869:0:31922:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@000000001ae8158e x1846792875510848/t4294967429(4294967429) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/600 e 0 to 0 dl 1761239766 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:2.0:1761239722.176903:0:31922:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1761239722.176909:0:31922:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c547ec2d x1846792875511104/t0(0) o35->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1761239722.176931:0:31922:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c547ec2d pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875511104:192.168.206.106@tcp:35:lfs.0 00000100:00100000:2.0:1761239722.176986:0:31922:0:(client.c:2500:ptlrpc_set_wait()) set 000000004b4731bb going to sleep for 6 seconds 00000100:00100000:2.0:1761239722.179084:0:31922:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c547ec2d pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31922:1846792875511104:192.168.206.106@tcp:35:lfs.0 00000002:00100000:2.0:1761239722.179129:0:31922:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@000000001ae8158e x1846792875510848/t4294967429(4294967429) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/600 e 0 to 0 dl 1761239766 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1761239722.191543:0:31923:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761239722.191580:0:31923:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761239722.191601:0:31923:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.191618:0:31923:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761239722.191630:0:31923:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761239722.191634:0:31923:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761239722.191642:0:31923:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 0000000039ca86ac 00010000:00010000:1.0:1761239722.191644:0:31923:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.191665:0:31923:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761239722.191683:0:31923:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:1.0:1761239722.191691:0:31923:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d15.ost-pools, flags=27 00000080:00200000:1.0:1761239722.191695:0:31923:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 1 00000080:00200000:1.0:1761239722.191707:0:31923:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), file 000000002f259d96, open_flags 18800, mode 0 opened 0 00000080:00200000:1.0:1761239722.191716:0:31923:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), intent=open 00000002:00010000:1.0:1761239722.191728:0:31923:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x0:0x0:0x0]) in obj [0x200000401:0x21:0x0], intent: open flags 0304001 00010000:00010000:1.0:1761239722.191786:0:31923:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.191794:0:31923:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1761239722.191807:0:31923:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1761239722.191820:0:31923:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c903b4d9 x1846792875511232/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1761239722.191829:0:31923:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239722.191854:0:31923:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c903b4d9 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511232:192.168.206.106@tcp:101:lfs.0 00000100:00100000:1.0:1761239722.194563:0:31923:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d74546a9 going to sleep for 43 seconds 00000100:00100000:3.0:1761239722.197535:0:31923:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c903b4d9 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511232:192.168.206.106@tcp:101:lfs.0 00010000:00010000:3.0:1761239722.197565:0:31923:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197603:0:31923:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197610:0:31923:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197618:0:31923:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197626:0:31923:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197634:0:31923:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007c89eebc already unused, calling callback (0000000089d89e79) 00010000:00010000:3.0:1761239722.197638:0:31923:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197645:0:31923:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197653:0:31923:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197661:0:31923:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1761239722.197667:0:31923:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.197673:0:31923:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000007c89eebc/0x39427fb11b5ed176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1761239722.197703:0:31923:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@00000000c903b4d9 x1846792875511232/t4294967432(4294967432) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1761239722.197716:0:31923:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000c903b4d9 x1846792875511232/t4294967432(4294967432) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1761239722.197755:0:31923:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:3.0:1761239722.197758:0:31923:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x22:0x0](0000000057b83100): rc = 0 00000080:00010000:3.0:1761239722.197765:0:31923:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0x22:0x0](0000000057b83100) for lock 0x0 00000080:00200000:3.0:1761239722.197793:0:31923:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), flags 304000 00000002:00100000:3.0:1761239722.197812:0:31923:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000c903b4d9 x1846792875511232/t4294967432(4294967432) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1761239722.197948:0:31923:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), inode mode 41ed mask 44 00000080:00200000:3.0:1761239722.198001:0:31923:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:3.0:1761239722.198017:0:31923:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1761239722.198031:0:31923:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.198041:0:31923:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1761239722.198051:0:31923:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:3.0:1761239722.198054:0:31923:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:3.0:1761239722.198060:0:31923:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 0000000039ca86ac 00010000:00010000:3.0:1761239722.198062:0:31923:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.198069:0:31923:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1761239722.198091:0:31923:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:3.0:1761239722.198097:0:31923:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d15.ost-pools, flags=24 00000080:00200000:3.0:1761239722.198100:0:31923:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 1 00000080:00200000:3.0:1761239722.198113:0:31923:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), file 00000000542eb98a, open_flags 28800, mode 0 opened 0 00000080:00200000:3.0:1761239722.198121:0:31923:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), intent=open 00000002:00010000:3.0:1761239722.198133:0:31923:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x0:0x0:0x0]) in obj [0x200000401:0x21:0x0], intent: open flags 0504001 00010000:00010000:3.0:1761239722.198191:0:31923:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.198199:0:31923:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1761239722.198210:0:31923:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1761239722.198216:0:31923:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d51c91d2 x1846792875511360/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1761239722.198223:0:31923:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761239722.199620:0:31923:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511360:192.168.206.106@tcp:101:lfs.0 00000100:00100000:3.0:1761239722.199833:0:31923:0:(client.c:2500:ptlrpc_set_wait()) set 000000001906f40a going to sleep for 43 seconds 00000100:00100000:3.0:1761239722.205170:0:31923:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511360:192.168.206.106@tcp:101:lfs.0 00010000:00010000:3.0:1761239722.205202:0:31923:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205220:0:31923:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205269:0:31923:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205276:0:31923:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205284:0:31923:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205290:0:31923:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fea013e5 already unused, calling callback (0000000089d89e79) 00010000:00010000:3.0:1761239722.205295:0:31923:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205303:0:31923:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205312:0:31923:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 5/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205330:0:31923:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1761239722.205336:0:31923:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761239722.205343:0:31923:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000fea013e5/0x39427fb11b5ed17d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31923 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1761239722.205362:0:31923:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@00000000d51c91d2 x1846792875511360/t4294967433(4294967433) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1761239722.205384:0:31923:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000d51c91d2 x1846792875511360/t4294967433(4294967433) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1761239722.205425:0:31923:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:3.0:1761239722.205428:0:31923:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x22:0x0](0000000057b83100): rc = 0 00000080:00010000:3.0:1761239722.205434:0:31923:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0x22:0x0](0000000057b83100) for lock 0x0 00000080:00200000:3.0:1761239722.205463:0:31923:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), flags 504000 00000002:00100000:3.0:1761239722.205480:0:31923:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000d51c91d2 x1846792875511360/t4294967433(4294967433) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1761239722.205503:0:31923:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@00000000d51c91d2 x1846792875511360/t4294967433(4294967433) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:3.0:1761239722.205534:0:31923:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1761239722.205539:0:31923:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003252b671 x1846792875511488/t0(0) o35->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1761239722.205562:0:31923:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003252b671 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511488:192.168.206.106@tcp:35:lfs.0 00000100:00100000:3.0:1761239722.205648:0:31923:0:(client.c:2500:ptlrpc_set_wait()) set 000000001906f40a going to sleep for 6 seconds 00000100:00100000:3.0:1761239722.208113:0:31923:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003252b671 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511488:192.168.206.106@tcp:35:lfs.0 00000002:00100000:3.0:1761239722.208155:0:31923:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@00000000d51c91d2 x1846792875511360/t4294967433(4294967433) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1761239722.208392:0:31923:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), inode mode 41ed mask 44 00000080:00200000:3.0:1761239722.208436:0:31923:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100) 00000080:00200000:3.0:1761239722.208480:0:31923:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), cmd=0x4008669b 00000100:00100000:3.0:1761239722.208538:0:31923:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511552:192.168.206.106@tcp:33:lfs.0 00000100:00100000:3.0:1761239722.208604:0:31923:0:(client.c:2500:ptlrpc_set_wait()) set 000000001906f40a going to sleep for 43 seconds 00000100:00100000:3.0:1761239722.210877:0:31923:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511552:192.168.206.106@tcp:33:lfs.0 00000080:00200000:0.0:1761239722.212033:0:31923:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100) 00000002:00100000:0.0:1761239722.212091:0:31923:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@00000000c903b4d9 x1846792875511232/t4294967432(4294967432) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:0.0:1761239722.212126:0:31923:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1761239722.212132:0:31923:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000093a61626 x1846792875511680/t0(0) o35->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1761239722.212158:0:31923:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093a61626 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511680:192.168.206.106@tcp:35:lfs.0 00000100:00100000:0.0:1761239722.212297:0:31923:0:(client.c:2500:ptlrpc_set_wait()) set 00000000949bed13 going to sleep for 6 seconds 00000100:00100000:1.0:1761239722.219531:0:31923:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093a61626 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31923:1846792875511680:192.168.206.106@tcp:35:lfs.0 00000002:00100000:1.0:1761239722.219576:0:31923:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@00000000c903b4d9 x1846792875511232/t4294967432(4294967432) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 648/600 e 0 to 0 dl 1761239766 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1761239722.231924:0:31924:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761239722.231959:0:31924:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761239722.231981:0:31924:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.231997:0:31924:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761239722.232010:0:31924:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761239722.232014:0:31924:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761239722.232024:0:31924:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 0000000078fb4158 00010000:00010000:1.0:1761239722.232027:0:31924:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.232035:0:31924:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761239722.232052:0:31924:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:1.0:1761239722.232061:0:31924:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d15.ost-pools, flags=25 00000080:00200000:1.0:1761239722.232065:0:31924:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](00000000b0d0752b), inode mode 41ed mask 1 00000080:00200000:1.0:1761239722.232076:0:31924:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), flags=25 00000080:00200000:1.0:1761239722.232082:0:31924:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](00000000b0d0752b), intent=0 00000002:00010000:1.0:1761239722.232093:0:31924:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x0:0x0:0x0]) in obj [0x200000401:0x21:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761239722.232152:0:31924:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.232160:0:31924:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761239722.232185:0:31924:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761239722.232217:0:31924:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c903b4d9 pname:cluuid:pid:xid:nid:opc:job createmany:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31924:1846792875511744:192.168.206.106@tcp:101:createmany.0 00000100:00100000:1.0:1761239722.232562:0:31924:0:(client.c:2500:ptlrpc_set_wait()) set 0000000061bf9f0b going to sleep for 43 seconds 00000100:00100000:1.0:1761239722.244651:0:31924:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c903b4d9 pname:cluuid:pid:xid:nid:opc:job createmany:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31924:1846792875511744:192.168.206.106@tcp:101:createmany.0 00010000:00010000:1.0:1761239722.244684:0:31924:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246162:0:31924:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246178:0:31924:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246190:0:31924:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246201:0:31924:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246215:0:31924:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246221:0:31924:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246237:0:31924:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1761239722.246294:0:31924:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@00000000c903b4d9 x1846792875511744/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 576/640 e 0 to 0 dl 1761239766 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'createmany.0' 00000002:00010000:0.0:1761239722.246305:0:31924:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246315:0:31924:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 00000000753932f7 type 13 mode 4 res 8589935617/34 (0 0) 00000080:00200000:0.0:1761239722.246345:0:31924:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:0.0:1761239722.246348:0:31924:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x22:0x0](0000000057b83100): rc = 0 00000080:00010000:0.0:1761239722.246356:0:31924:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0x22:0x0](0000000057b83100) for lock 0x39427fb11b5ed184 00000080:00010000:0.0:1761239722.246381:0:31924:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x22:0x0](0000000057b83100) 00000080:00010000:0.0:1761239722.246385:0:31924:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ed184 from it 0000000083278bba 00010000:00010000:0.0:1761239722.246387:0:31924:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246394:0:31924:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000c02f40a7/0x39427fb11b5ed184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64a2ad6 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1761239722.246432:0:31924:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), inode mode 41ed mask 1 00000080:00200000:0.0:1761239722.246452:0:31924:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](0000000057b83100), inode mode 41ed mask 3 00000080:00200000:0.0:1761239722.246457:0:31924:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f15.ost-pools0, dir=[0x200000401:0x22:0x0](0000000057b83100), file 00000000ef4ae779, open_flags 8042, mode 81a4 opened 0 00000080:00200000:0.0:1761239722.246466:0:31924:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f15.ost-pools0, dir=[0x200000401:0x22:0x0](0000000057b83100), intent=open|creat 00000002:00010000:0.0:1761239722.246490:0:31924:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f15.ost-pools0,[0x200000401:0x24:0x0]) in obj [0x200000401:0x22:0x0], intent: open|creat flags 0100103 00010000:00010000:0.0:1761239722.246544:0:31924:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239722.246551:0:31924:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1761239722.246562:0:31924:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1761239722.246567:0:31924:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000aad87e33 x1846792875511872/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1761239722.246573:0:31924:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761239722.246595:0:31924:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aad87e33 pname:cluuid:pid:xid:nid:opc:job createmany:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31924:1846792875511872:192.168.206.106@tcp:101:createmany.0 00000100:00100000:0.0:1761239722.248714:0:31924:0:(client.c:2500:ptlrpc_set_wait()) set 000000008a457d0a going to sleep for 43 seconds 00010000:00010000:2.0:1761239722.815771:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239723.839586:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239724.863503:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1761239725.057479:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761239725.057487:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1761239725.057490:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761239725.057514:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1761239725.057592:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c547ec2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875511936:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1761239725.057725:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1761239725.057733:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875512000:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1761239725.067195:0:2217:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff969f82c5a000: committing for last_committed 4294967435 gen 1 00000100:00100000:3.0:1761239725.067280:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ae8158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875512000:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1761239725.067298:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c547ec2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875511936:192.168.206.106@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1761239725.887559:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239726.913666:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239727.936771:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239728.959541:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239729.983462:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1761239730.176388:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1761239730.176552:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875512064:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1761239730.176680:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1761239730.176688:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003252b671 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875512128:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00080000:3.0:1761239730.176995:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:3.0:1761239730.176999:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1761239730.177002:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1761239730.181474:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d51c91d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792875512064:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1761239730.183121:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003252b671 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792875512128:192.168.206.106@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1761239731.007528:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239732.032150:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239733.056025:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239734.079434:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239735.106204:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1761239735.295667:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761239735.295681:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761239735.295683:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761239735.295686:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1761239735.295717:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e4ec9697 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792875512256:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761239735.296837:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008217df84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792875512192:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761239735.308026:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e4ec9697 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792875512256:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1761239735.308101:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008217df84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792875512192:192.168.206.106@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1761239736.127478:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239737.151446:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761239738.175509:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239739.200376:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239740.223482:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1761239740.415406:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761239740.415412:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761239740.415414:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761239740.415417:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1761239740.415491:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008217df84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792875512320:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761239740.415582:0:2215:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1761239740.415589:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089ebbd4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792875512384:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761239740.422280:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089ebbd4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792875512384:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761239740.422305:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008217df84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792875512320:192.168.206.106@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1761239741.247591:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761239742.271444:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1761239742.556534:0:31924:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aad87e33 pname:cluuid:pid:xid:nid:opc:job createmany:4ffd2023-cacd-4e39-8a6e-05d927860e2a:31924:1846792875511872:192.168.206.106@tcp:101:createmany.0 00010000:00010000:0.0:1761239742.556556:0:31924:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556570:0:31924:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556576:0:31924:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556583:0:31924:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 3/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556590:0:31924:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 4/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556595:0:31924:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d8e369a7 already unused, calling callback (0000000089d89e79) 00010000:00010000:0.0:1761239742.556599:0:31924:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 4/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556620:0:31924:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 4/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556627:0:31924:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 5/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556634:0:31924:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1761239742.556640:0:31924:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 3/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761239742.556646:0:31924:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000d8e369a7/0x39427fb11b5ed18b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 31924 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1761239742.556666:0:31924:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=17, status=-28 req@00000000aad87e33 x1846792875511872/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761239766 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'createmany.0' 00000080:00200000:0.0:1761239742.556750:0:31924:0:(namei.c:1405:ll_create_it()) VFS Op:name=f15.ost-pools0, dir=[0x200000401:0x22:0x0](0000000057b83100), intent=open|creat 00010000:00010000:0.0:1761239743.297195:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1761239743.727619:0:32052:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1761239743.727625:0:32052:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: ost-pools test_15: @@@@@@ FAIL: createmany /mnt/lustre/d15.ost-pools/dir0/f15.ost-pools failed! 00010000:00010000:3.0:1761239744.321278:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1247 lines, 1247 kept, 0 dropped, 0 bad.