00010000:00010000:0.0F:1761240880.000221:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1761240881.026580:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1761240882.047678:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1761240882.177961:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761240882.177971:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1761240882.177975:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761240882.177978:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1761240882.178001:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876693440:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1761240882.178003:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792876693504:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1761240882.184513:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876693440:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1761240882.184572:0:2218:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff969f82c5a000: committing for last_committed 4294976171 gen 1 00000100:00100000:2.0:1761240882.184587:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792876693504:192.168.206.106@tcp:400:kworker/u8:2.0 00010000:00010000:0.0:1761240883.071482:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1761240883.431116:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240883.431869:0:18415:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884551616 00000100:00100000:0.0:1761240883.431938:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 283 00000100:00100000:0.0:1761240883.431945:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007925dc3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:44668:x1846792884551616:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240883.431969:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000f6e9dc04/0x39427fb11b5f25a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5d3c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240883.432080:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240883.432085:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007925dc3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:44668:x1846792884551616:12345-192.168.206.106@tcp:104: Request processed in 140us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240883.432092:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 283 00010000:00010000:3.0:1761240883.432664:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240883.432671:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000f6e9dc04/0x39427fb11b5f25a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5d3c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240883.432680:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f6e9dc04 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240883.432683:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000f6e9dc04/0x39427fb11b5f25a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d5d3c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240883.432690:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000f6e9dc04/0x39427fb11b5f25a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d5d3c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240883.432696:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000f6e9dc04/0x39427fb11b5f25a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d5d3c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240883.432701:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240883.432864:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000f6e9dc04/0x39427fb11b5f25a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5d3c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240883.432872:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240883.435140:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000f6e9dc04/0x39427fb11b5f25a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5d3c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240883.435159:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000f6e9dc04/0x39427fb11b5f25a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5d3c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240883.435179:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240883.435181:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240883.435183:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1761240883.435413:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005bb7cd8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876693568:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1761240883.437075:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761240883.437188:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884551872 00000100:00100000:1.0:1761240883.437277:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 284 00000100:00100000:1.0:1761240883.437285:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f93a80c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:44668:x1846792884551872:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761240883.437304:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000e7aea49f/0x39427fb11b5f25a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5d0b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240883.437383:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1761240883.437999:0:4996:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1761240883.438005:0:4996:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000e7aea49f/0x39427fb11b5f25a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5d0b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240883.438014:0:4996:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e7aea49f already unused, calling callback (00000000d1e5b923) 10000000:00010000:2.0:1761240883.438018:0:4996:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000e7aea49f/0x39427fb11b5f25a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d5d0b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240883.438025:0:4996:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000e7aea49f/0x39427fb11b5f25a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d5d0b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1761240883.438031:0:4996:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000e7aea49f/0x39427fb11b5f25a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d5d0b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240883.438035:0:4996:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1761240883.438091:0:4996:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000e7aea49f/0x39427fb11b5f25a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5d0b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240883.438114:0:4996:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1761240883.438148:0:4996:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000e7aea49f/0x39427fb11b5f25a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5d0b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240883.438154:0:4996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000e7aea49f/0x39427fb11b5f25a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5d0b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240883.438173:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240883.438175:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240883.438176:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1761240883.438189:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1761240883.438207:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876693632:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1761240883.438317:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f93a80c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:44668:x1846792884551872:12345-192.168.206.106@tcp:104: Request processed in 1031us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1761240883.438327:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 284 00000100:00100000:2.0:1761240883.440023:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005bb7cd8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876693568:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761240883.442794:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876693632:192.168.206.106@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1761240884.098818:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1761240884.863412:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1761240884.863424:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 515 10000000:01000000:0.0:1761240884.863431:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1761240884.863500:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240884.863514:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240884.863526:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240884.863563:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876693696:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761240884.863681:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000054934904 going to sleep for 6 seconds 00000100:00100000:0.0:1761240884.871183:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876693696:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1761240884.871223:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240884.871285:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240884.871386:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876693760:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240884.873123:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000054934904 going to sleep for 6 seconds 00000100:00100000:0.0:1761240884.880926:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876693760:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240884.881010:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876693824:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1761240884.881125:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000054934904 going to sleep for 6 seconds 00000100:00100000:0.0:1761240884.893218:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876693824:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1761240884.897288:0:41368:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41368:1846792876693888:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:0.0:1761240884.897422:0:41368:0:(client.c:2500:ptlrpc_set_wait()) set 000000008ab47998 going to sleep for 6 seconds 00000100:00100000:0.0:1761240884.904295:0:41368:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41368:1846792876693888:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:0.0:1761240884.904374:0:41368:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1761240884.904391:0:41368:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1761240884.904393:0:41368:0:(obd_config.c:1460:class_process_config()) marker 337 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:0.0:1761240884.904401:0:41368:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:0.0:1761240884.904404:0:41368:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1761240884.904420:0:41368:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:0.0:1761240884.904468:0:41368:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41368:1846792876693952:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:0.0:1761240884.904573:0:41368:0:(client.c:2500:ptlrpc_set_wait()) set 000000008ab47998 going to sleep for 6 seconds 00000100:00100000:0.0:1761240884.911727:0:41368:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41368:1846792876693952:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:0.0:1761240884.911787:0:41368:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1761240884.911821:0:41368:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1761240884.911824:0:41368:0:(obd_config.c:1460:class_process_config()) marker 337 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:0.0:1761240884.911829:0:41368:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 518 count 507 00000020:01000000:1.0:1761240884.912339:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 515-517 (rc=0) 10000000:01000000:1.0:1761240884.912365:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1761240884.912374:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240884.912386:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1761240884.912397:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1761240884.912400:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:1.0:1761240884.912403:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1761240884.912444:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240884.912451:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240884.912461:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761240884.912486:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002588e81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694016:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761240884.912580:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eca3458a going to sleep for 6 seconds 00000100:00100000:0.0:1761240884.926915:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002588e81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694016:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1761240884.926956:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240884.926972:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240884.927089:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694080:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240884.927186:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000054934904 going to sleep for 6 seconds 00000100:00100000:0.0:1761240884.935678:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ab1a290 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694080:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1761240884.935747:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1761240884.935757:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240884.935771:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240885.120127:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240886.146613:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1761240886.914583:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761240886.914630:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240886.914702:0:4987:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1761240886.914729:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884554944 00000100:00100000:0.0:1761240886.914780:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884555008 00000100:00100000:0.0:1761240886.914794:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 285 00000100:00100000:0.0:1761240886.914801:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001075909b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:44776:x1846792884554944:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240886.914817:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240886.914914:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240886.914919:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001075909b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:44776:x1846792884554944:12345-192.168.206.106@tcp:104: Request processed in 118us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240886.914926:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 285 00000100:00100000:0.0:1761240886.914941:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 286 00000100:00100000:0.0:1761240886.914944:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d08c95f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:44776:x1846792884555008:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240886.914950:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240886.914982:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1761240886.914986:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d08c95f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:44776:x1846792884555008:12345-192.168.206.106@tcp:104: Request processed in 41us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240886.914991:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 286 00010000:00010000:2.0:1761240886.915028:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1761240886.915033:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915041:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000024b49eb9 already unused, calling callback (00000000d1e5b923) 10000000:00010000:2.0:1761240886.915044:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915050:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1761240886.915057:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240886.915074:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1761240886.915120:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915126:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1761240886.915145:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915150:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000024b49eb9/0x39427fb11b5f2602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5e8c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915161:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1761240886.915163:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915167:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000063e4cc2b already unused, calling callback (00000000d1e5b923) 10000000:00010000:2.0:1761240886.915169:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915174:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1761240886.915179:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240886.915183:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1761240886.915193:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915199:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1761240886.915203:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915214:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000063e4cc2b/0x39427fb11b5f25fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5e85 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240886.915225:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240886.915227:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240886.915228:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1761240886.915274:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876694144:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761240886.915318:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1761240886.915324:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876694208:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1761240886.915435:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1761240886.922102:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876694208:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761240886.922116:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876694144:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1761240887.167464:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1761240887.299983:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240887.299990:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761240887.299992:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240887.299995:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1761240887.300012:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bd85f10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792876694336:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240887.300012:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000079ffb785 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792876694272:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240887.306714:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bd85f10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792876694336:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240887.307920:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000079ffb785 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792876694272:192.168.206.106@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1761240888.191438:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1761240888.575379:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1761240888.575388:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 518 10000000:01000000:0.0:1761240888.575394:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1761240888.575446:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240888.575457:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240888.575486:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240888.575524:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020f5b740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694400:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761240888.575614:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f9781c4a going to sleep for 6 seconds 00000100:00100000:0.0:1761240888.584533:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020f5b740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694400:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1761240888.584563:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240888.584575:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240888.584660:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020f5b740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694464:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240888.584728:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f9781c4a going to sleep for 6 seconds 00000100:00100000:1.0:1761240888.589294:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020f5b740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694464:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1761240888.589353:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694528:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1761240888.589440:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ab275644 going to sleep for 6 seconds 00000100:00100000:1.0:1761240888.595790:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694528:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1761240888.607403:0:41386:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41386:1846792876694592:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:1.0:1761240888.607497:0:41386:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d0a3b9ff going to sleep for 6 seconds 00000100:00100000:1.0:1761240888.626293:0:41386:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41386:1846792876694592:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:1.0:1761240888.626336:0:41386:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1761240888.626347:0:41386:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1761240888.626349:0:41386:0:(obd_config.c:1460:class_process_config()) marker 339 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:1.0:1761240888.626355:0:41386:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:1.0:1761240888.626358:0:41386:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1761240888.626411:0:41386:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41386:1846792876694656:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:1.0:1761240888.626497:0:41386:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d0a3b9ff going to sleep for 6 seconds 00000100:00100000:1.0:1761240888.640033:0:41386:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41386:1846792876694656:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:1.0:1761240888.640077:0:41386:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1761240888.640085:0:41386:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1761240888.640087:0:41386:0:(obd_config.c:1460:class_process_config()) marker 339 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:1.0:1761240888.640091:0:41386:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 521 count 510 00000020:01000000:0.0:1761240888.640339:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 518-520 (rc=0) 10000000:01000000:0.0:1761240888.640358:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1761240888.640365:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240888.640375:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1761240888.640384:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1761240888.640386:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:0.0:1761240888.640388:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1761240888.640415:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240888.640434:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240888.640441:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240888.640457:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063c4a810 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694720:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761240888.644460:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000005c637bf2 going to sleep for 6 seconds 00000100:00100000:1.0:1761240888.649608:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063c4a810 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694720:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1761240888.649636:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240888.649649:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761240888.649720:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694784:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1761240888.649774:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ab275644 going to sleep for 6 seconds 00000100:00100000:1.0:1761240888.655978:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876694784:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1761240888.656037:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1761240888.656044:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240888.656056:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240889.217776:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1761240889.844154:0:40686:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:3.0:1761240889.844179:0:40686:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1761240889.844195:0:40686:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 00000000753932f7 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:3.0:1761240889.844284:0:40686:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240889.844294:0:40686:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240889.844303:0:40686:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761240889.844330:0:40686:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae33d1a3 pname:cluuid:pid:xid:nid:opc:job bash:4ffd2023-cacd-4e39-8a6e-05d927860e2a:40686:1846792876694848:192.168.206.106@tcp:101:bash.0 00000100:00100000:3.0:1761240889.844416:0:40686:0:(client.c:2500:ptlrpc_set_wait()) set 00000000650ea77d going to sleep for 31 seconds 00000100:00100000:2.0:1761240889.855975:0:40686:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae33d1a3 pname:cluuid:pid:xid:nid:opc:job bash:4ffd2023-cacd-4e39-8a6e-05d927860e2a:40686:1846792876694848:192.168.206.106@tcp:101:bash.0 00010000:00010000:2.0:1761240889.856000:0:40686:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.856025:0:40686:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.856037:0:40686:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.856048:0:40686:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.856078:0:40686:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.856085:0:40686:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.856090:0:40686:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1761240889.856099:0:40686:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@00000000ae33d1a3 x1846792876694848/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 576/688 e 0 to 0 dl 1761240921 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:2.0:1761240889.856112:0:40686:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.856124:0:40686:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 00000000753932f7 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1761240889.856153:0:40686:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 11776 00000080:00010000:2.0:1761240889.856160:0:40686:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5f2617 00000080:00010000:2.0:1761240889.856166:0:40686:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:2.0:1761240889.856168:0:40686:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5f2617 from it 00000000b0ac7c3d 00010000:00010000:2.0:1761240889.856170:0:40686:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.856177:0:40686:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1761240889.864320:0:41415:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:2.0:1761240889.864348:0:41415:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1761240889.864365:0:41415:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.864385:0:41415:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1761240889.864394:0:41415:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:2.0:1761240889.864397:0:41415:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:2.0:1761240889.864405:0:41415:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000fd8f7a48 00010000:00010000:2.0:1761240889.864407:0:41415:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.864414:0:41415:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1761240889.864428:0:41415:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 44 00000080:00200000:2.0:1761240889.864435:0:41415:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), flags 320400 00000080:00200000:2.0:1761240889.864450:0:41415:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), cmd=0x4008669a 00010000:00010000:2.0:1761240889.864463:0:41415:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.864477:0:41415:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.864526:0:41415:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240889.864532:0:41415:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1761240889.864534:0:41415:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 00000000a28ceb25/0x39427fb11b5f2617 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x998704a8c64d5f73 expref: -99 pid: 40686 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1761240889.864549:0:41415:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1761240889.864565:0:41415:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005e2f6492 x1846792876694976/t0(0) o36->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 520/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1761240889.864586:0:41415:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41415:1846792876694976:192.168.206.106@tcp:36:lfs.0 00000100:00100000:2.0:1761240889.866658:0:41415:0:(client.c:2500:ptlrpc_set_wait()) set 0000000047aa949b going to sleep for 31 seconds 00000100:00100000:2.0:1761240889.872207:0:41415:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41415:1846792876694976:192.168.206.106@tcp:36:lfs.0 00000080:00200000:2.0:1761240889.872296:0:41415:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a) 00010000:00010000:3.0:1761240890.240026:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240891.264577:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240892.287953:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1761240892.415920:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761240892.415926:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1761240892.415929:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761240892.415931:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1761240892.415962:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aad87e33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792876695104:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1761240892.416065:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1761240892.416071:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876695040:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1761240892.428378:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876695040:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1761240892.428400:0:2218:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff969f82c5a000: committing for last_committed 4294976172 gen 1 00000100:00100000:2.0:1761240892.428417:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aad87e33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792876695104:192.168.206.106@tcp:400:kworker/u8:1.0 00010000:00010000:1.0:1761240893.311359:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240894.335781:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240895.360728:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1761240896.383593:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240897.415602:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1761240897.536364:0:40653:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761240897.536370:0:40653:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1761240897.536373:0:40653:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1761240897.536374:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aad87e33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876695168:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00080000:2.0:1761240897.536375:0:40653:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1761240897.536395:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792876695232:192.168.206.106@tcp:400:kworker/u8:4.0 00000400:00000080:2.0:1761240897.541152:0:41668:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1761240897.541157:0:41668:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 22: Simultaneous manipulation of a pool ========================================================== 13:34:56 (1761240896) 00000100:00100000:3.0:1761240897.545033:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aad87e33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876695168:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1761240897.552984:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2218:1846792876695232:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1761240898.387208:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240898.387300:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884559104 00000100:00100000:0.0:1761240898.387377:0:4986:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 287 00000100:00100000:0.0:1761240898.387385:0:4986:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009346b37f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45399:x1846792884559104:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240898.387406:0:4986:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240898.387502:0:4986:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240898.387509:0:4986:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009346b37f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45399:x1846792884559104:12345-192.168.206.106@tcp:104: Request processed in 124us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240898.387516:0:4986:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 287 00010000:00010000:3.0:1761240898.388149:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240898.388157:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.388167:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e77042c7 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240898.388171:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.388198:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240898.388204:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240898.388210:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240898.388290:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.388297:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1761240898.388375:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a460883d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876695296:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1761240898.391033:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.391054:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000e77042c7/0x39427fb11b5f2610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f03 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.391077:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240898.391079:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240898.391082:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1761240898.391199:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240898.391815:0:18415:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884559168 00000100:00100000:0.0:1761240898.391880:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 288 00000100:00100000:0.0:1761240898.391889:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6fe2741 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45399:x1846792884559168:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240898.392047:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240898.392143:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240898.392150:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6fe2741 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45399:x1846792884559168:12345-192.168.206.106@tcp:104: Request processed in 261us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240898.392171:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 288 00010000:00010000:3.0:1761240898.392573:0:4996:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240898.392579:0:4996:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.392589:0:4996:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005daa001d already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240898.392592:0:4996:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.392600:0:4996:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240898.392619:0:4996:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240898.392625:0:4996:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240898.392669:0:4996:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.392676:0:4996:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240898.392712:0:4996:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240898.392718:0:4996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 000000005daa001d/0x39427fb11b5f2609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5efc expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240898.393487:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb8c21dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876695360:192.168.206.106@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1761240898.393820:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240898.393823:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240898.393824:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1761240898.394695:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a460883d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876695296:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1761240898.399990:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb8c21dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876695360:192.168.206.106@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1761240898.433054:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240899.456986:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1761240900.031406:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1761240900.032013:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 521 10000000:01000000:0.0:1761240900.032021:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1761240900.032083:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240900.032098:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240900.032110:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240900.032142:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695424:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761240900.032299:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000008afb773b going to sleep for 6 seconds 00000100:00100000:0.0:1761240900.039172:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695424:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1761240900.039284:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240900.039299:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240900.039391:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695488:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240900.039468:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000008afb773b going to sleep for 6 seconds 00000100:00100000:0.0:1761240900.042456:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695488:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240900.042537:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695552:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1761240900.042657:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000008afb773b going to sleep for 6 seconds 00000100:00100000:0.0:1761240900.046507:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695552:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1761240900.047550:0:41690:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000468126a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41690:1846792876695616:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761240900.047660:0:41690:0:(client.c:2500:ptlrpc_set_wait()) set 000000007111403a going to sleep for 6 seconds 00000100:00100000:3.0:1761240900.059995:0:41690:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000468126a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41690:1846792876695616:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761240900.060058:0:41690:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1761240900.060071:0:41690:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761240900.060073:0:41690:0:(obd_config.c:1460:class_process_config()) marker 341 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1761240900.060082:0:41690:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:3.0:1761240900.060085:0:41690:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1761240900.060109:0:41690:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1761240900.060156:0:41690:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000468126a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41690:1846792876695680:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761240900.060295:0:41690:0:(client.c:2500:ptlrpc_set_wait()) set 000000003b6f04e0 going to sleep for 6 seconds 00000100:00100000:3.0:1761240900.068299:0:41690:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000468126a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41690:1846792876695680:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761240900.068366:0:41690:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1761240900.068377:0:41690:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761240900.068380:0:41690:0:(obd_config.c:1460:class_process_config()) marker 341 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1761240900.068385:0:41690:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 525 count 513 00000020:01000000:0.0:1761240900.068839:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 521-524 (rc=0) 10000000:01000000:0.0:1761240900.068869:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1761240900.068878:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240900.068890:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1761240900.068901:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1761240900.068903:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:0.0:1761240900.068906:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1761240900.068945:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240900.068965:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240900.068976:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240900.069000:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695744:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761240900.069176:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000008afb773b going to sleep for 6 seconds 00000100:00100000:0.0:1761240900.076869:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695744:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1761240900.076907:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240900.076922:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240900.077050:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695808:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240900.077136:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000008afb773b going to sleep for 6 seconds 00000100:00100000:0.0:1761240900.082303:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062edd164 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876695808:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1761240900.082369:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1761240900.082380:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240900.082394:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240900.482309:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240901.507338:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1761240901.985119:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240901.985191:0:18415:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884561984 00000100:00100000:0.0:1761240901.985317:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 289 00000100:00100000:0.0:1761240901.985325:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062edd164 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45503:x1846792884561984:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240901.985347:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240901.985451:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240901.985458:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062edd164 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45503:x1846792884561984:12345-192.168.206.106@tcp:104: Request processed in 132us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240901.985467:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 289 00010000:00010000:3.0:1761240901.985564:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240901.985571:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.985580:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059c7a202 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240901.985584:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.985592:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240901.985600:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240901.985606:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240901.985656:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.985663:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240901.985683:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.985689:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000059c7a202/0x39427fb11b5f2625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f8f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.985725:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240901.985727:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240901.985728:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240901.985736:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1761240901.985758:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000468126a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876695872:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1761240901.990356:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761240901.990500:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884562048 00000100:00100000:1.0:1761240901.990564:0:4986:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 290 00000100:00100000:1.0:1761240901.990572:0:4986:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f93a80c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45503:x1846792884562048:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761240901.990594:0:4986:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240901.990711:0:4986:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1761240901.990717:0:4986:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f93a80c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45503:x1846792884562048:12345-192.168.206.106@tcp:104: Request processed in 145us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1761240901.990725:0:4986:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 290 00010000:00010000:3.0:1761240901.991312:0:4996:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240901.991319:0:4996:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.991328:0:4996:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000798ce77f already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240901.991331:0:4996:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.991339:0:4996:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240901.991345:0:4996:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240901.991349:0:4996:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240901.991393:0:4996:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.991399:0:4996:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240901.991429:0:4996:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.991435:0:4996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000798ce77f/0x39427fb11b5f261e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d5f88 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240901.991473:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240901.991475:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240901.991476:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240901.991495:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1761240901.991515:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0c76d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876695936:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1761240901.995033:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000468126a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876695872:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1761240901.995118:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0c76d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876695936:192.168.206.106@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1761240902.527502:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1761240902.655443:0:40653:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761240902.655453:0:40653:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1761240902.655456:0:40653:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1761240902.655458:0:40653:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1761240902.655479:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792876696000:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1761240902.660169:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea50ef51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2217:1846792876696000:192.168.206.106@tcp:400:kworker/u8:4.0 10000000:01000000:1.0:1761240903.039481:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1761240903.039492:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 525 10000000:01000000:1.0:1761240903.039499:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1761240903.039625:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240903.039639:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240903.039650:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761240903.039682:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822101cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696064:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761240903.040080:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d0a3b9ff going to sleep for 6 seconds 00000100:00100000:2.0:1761240903.052795:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822101cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696064:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240903.052830:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240903.052845:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240903.052959:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696128:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240903.053040:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ea4805e6 going to sleep for 6 seconds 00000100:00100000:2.0:1761240903.061517:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696128:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240903.061597:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696192:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761240903.061704:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ea4805e6 going to sleep for 6 seconds 00000100:00100000:3.0:1761240903.078095:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2f6492 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696192:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1761240903.079298:0:41735:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0c76d17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41735:1846792876696256:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761240903.079407:0:41735:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ef222d7a going to sleep for 6 seconds 00000100:00100000:1.0:1761240903.089376:0:41735:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0c76d17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41735:1846792876696256:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:1.0:1761240903.089436:0:41735:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1761240903.089449:0:41735:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1761240903.089452:0:41735:0:(obd_config.c:1460:class_process_config()) marker 343 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:1.0:1761240903.089457:0:41735:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:1.0:1761240903.089468:0:41735:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1761240903.089481:0:41735:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:1.0:1761240903.089526:0:41735:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000012f87d0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41735:1846792876696320:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:1.0:1761240903.089622:0:41735:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eca3458a going to sleep for 6 seconds 00000100:00100000:3.0:1761240903.098773:0:41735:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000012f87d0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41735:1846792876696320:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761240903.098832:0:41735:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1761240903.098842:0:41735:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761240903.098845:0:41735:0:(obd_config.c:1460:class_process_config()) marker 343 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1761240903.098852:0:41735:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 528 count 516 00000020:01000000:1.0:1761240903.099034:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 525-527 (rc=0) 10000000:01000000:1.0:1761240903.099067:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1761240903.099076:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240903.099089:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1761240903.099099:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1761240903.099102:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:1.0:1761240903.099105:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1761240903.099146:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240903.099152:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240903.099161:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761240903.099183:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000820a7c14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696384:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761240903.099293:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000006cf67f7 going to sleep for 6 seconds 00000100:00100000:2.0:1761240903.110072:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000820a7c14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696384:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240903.110123:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240903.110144:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240903.110263:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006a19dbfd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696448:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240903.110363:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026b9a427 going to sleep for 6 seconds 00000100:00100000:2.0:1761240903.116474:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006a19dbfd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696448:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1761240903.116548:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1761240903.116560:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240903.116573:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240903.553278:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240904.575471:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1761240904.668146:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240904.668196:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761240904.668303:0:18415:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884564736 00000100:00100000:1.0:1761240904.668356:0:18415:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884564800 00000100:00100000:1.0:1761240904.668368:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 291 00000100:00100000:1.0:1761240904.668375:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ab1a290 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:45610:x1846792884564736:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761240904.668405:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240904.668473:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1761240904.668478:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ab1a290 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:45610:x1846792884564736:12345-192.168.206.106@tcp:104: Request processed in 103us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1761240904.668485:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 291 00000100:00100000:1.0:1761240904.668501:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 292 00000100:00100000:1.0:1761240904.668505:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063c4a810 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45610:x1846792884564800:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761240904.668511:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240904.668549:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1761240904.668554:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063c4a810 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45610:x1846792884564800:12345-192.168.206.106@tcp:104: Request processed in 49us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1761240904.668560:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 292 00010000:00010000:2.0:1761240904.669007:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1761240904.669010:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1761240904.669013:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240904.669014:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240904.669028:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000074465c86 already unused, calling callback (00000000d1e5b923) 00010000:00010000:3.0:1761240904.669029:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052623cd8 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240904.669031:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1761240904.669031:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240904.669039:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240904.669039:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240904.669046:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1761240904.669046:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240904.669052:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1761240904.669052:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240904.669216:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240904.669223:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240904.669340:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240904.669347:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000052623cd8/0x39427fb11b5f262c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6061 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240904.669360:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240904.669361:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240904.669363:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240904.669370:0:2217:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1761240904.669387:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d586b686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876696576:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1761240904.673561:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240904.673579:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1761240904.673609:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240904.673616:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000074465c86/0x39427fb11b5f2633 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6068 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240904.673636:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240904.673638:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240904.673640:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240904.676038:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1761240904.676082:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006a19dbfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876696512:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1761240904.680046:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d586b686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876696576:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1761240904.687863:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006a19dbfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876696512:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1761240905.599534:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1761240905.919354:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1761240905.919365:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 528 10000000:01000000:1.0:1761240905.919372:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1761240905.919443:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240905.919457:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240905.919469:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761240905.919502:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ee2b862 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696640:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761240905.922692:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eca3458a going to sleep for 6 seconds 00000100:00100000:2.0:1761240905.926588:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ee2b862 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696640:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240905.926622:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240905.926638:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240905.926764:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696704:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240905.926870:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009796b4fd going to sleep for 6 seconds 00000100:00100000:2.0:1761240905.931675:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696704:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240905.931821:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696768:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761240905.932548:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009796b4fd going to sleep for 6 seconds 00000100:00100000:2.0:1761240905.943097:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696768:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761240905.943789:0:41761:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41761:1846792876696832:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761240905.943911:0:41761:0:(client.c:2500:ptlrpc_set_wait()) set 000000007c781c45 going to sleep for 6 seconds 00000100:00100000:2.0:1761240905.948974:0:41761:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41761:1846792876696832:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761240905.949033:0:41761:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1761240905.949050:0:41761:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761240905.949052:0:41761:0:(obd_config.c:1460:class_process_config()) marker 345 (0x1) lustre-clilov new lustre.testpool2 00000020:01000000:2.0:1761240905.949059:0:41761:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:2.0:1761240905.949062:0:41761:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1761240905.949086:0:41761:0:(lov_pool.c:313:lov_pool_new()) testpool2 is pool #2 00000100:00100000:2.0:1761240905.949123:0:41761:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41761:1846792876696896:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761240905.950261:0:41761:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bc383f1e going to sleep for 6 seconds 00000100:00100000:2.0:1761240905.960687:0:41761:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41761:1846792876696896:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761240905.960728:0:41761:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1761240905.960737:0:41761:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761240905.960739:0:41761:0:(obd_config.c:1460:class_process_config()) marker 345 (0x2) lustre-clilov new lustre.testpool2 00000040:00080000:2.0:1761240905.960744:0:41761:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 531 count 519 00000020:01000000:1.0:1761240905.961122:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 528-530 (rc=0) 10000000:01000000:1.0:1761240905.961163:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1761240905.961172:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240905.961183:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1761240905.961194:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1761240905.961195:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:1.0:1761240905.961199:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1761240905.961229:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240905.961235:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240905.961281:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761240905.961307:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000b00089 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696960:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761240905.961394:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d0a3b9ff going to sleep for 6 seconds 00000100:00100000:2.0:1761240905.966575:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000b00089 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876696960:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240905.966616:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240905.966639:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240905.966755:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697024:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240905.966849:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bc383f1e going to sleep for 6 seconds 00000100:00100000:2.0:1761240905.975509:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697024:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1761240905.975582:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1761240905.975591:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240905.975602:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240906.625163:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1761240907.648378:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1761240907.780169:0:40653:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1761240907.780175:0:40653:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1761240907.780177:0:40653:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1761240907.780180:0:40653:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1761240907.780221:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048e36ac8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792876697152:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1761240907.780337:0:2216:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1761240907.780343:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020f5b740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876697088:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1761240907.782283:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020f5b740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876697088:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1761240907.782302:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048e36ac8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792876697152:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1761240908.559744:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240908.559797:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761240908.559944:0:4987:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1761240908.559969:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884568448 00000100:00100000:3.0:1761240908.559984:0:4989:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884568512 00000100:00100000:3.0:1761240908.560054:0:4989:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 16 00000100:00100000:3.0:1761240908.560062:0:4989:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048e36ac8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:45715:x1846792884568512:12345-192.168.206.106@tcp:104: 00010000:00010000:3.0:1761240908.560082:0:4989:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.560179:0:4989:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1761240908.560184:0:4989:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048e36ac8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:45715:x1846792884568512:12345-192.168.206.106@tcp:104: Request processed in 122us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1761240908.560192:0:4989:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 16 00010000:00010000:3.0:1761240908.560217:0:4996:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240908.560222:0:4996:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.560230:0:4996:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f7dd5737 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240908.560234:0:4996:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.560276:0:4996:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240908.560283:0:4996:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240908.560288:0:4996:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240908.560331:0:4996:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.560358:0:4996:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240908.560378:0:4996:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.560385:0:4996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000f7dd5737/0x39427fb11b5f263a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6076 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.560401:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240908.560402:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240908.560404:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240908.560428:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d586b686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876697216:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1761240908.560601:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 293 00000100:00100000:1.0:1761240908.560610:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055c4a7ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45715:x1846792884568448:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761240908.560626:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240908.560766:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1761240908.560771:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055c4a7ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45715:x1846792884568448:12345-192.168.206.106@tcp:104: Request processed in 162us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1761240908.560778:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 293 00010000:00010000:3.0:1761240908.564783:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240908.564794:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.564807:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009369e6c0 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240908.564810:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.564819:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240908.564826:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240908.564831:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240908.564880:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.564885:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240908.564933:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.564939:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 000000009369e6c0/0x39427fb11b5f2641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d607d expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240908.564958:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240908.564959:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240908.564961:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240908.564988:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c15923ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876697280:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1761240908.566371:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d586b686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876697216:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1761240908.582988:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c15923ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876697280:192.168.206.106@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1761240908.671587:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240909.695721:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1761240909.889743:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1761240909.889751:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 531 10000000:01000000:2.0:1761240909.889756:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1761240909.889802:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240909.889814:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240909.889823:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240909.889863:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697344:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1761240909.889962:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000194716a4 going to sleep for 6 seconds 00000100:00100000:2.0:1761240909.892322:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697344:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240909.892358:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240909.892374:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240909.892459:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697408:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240909.892538:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000194716a4 going to sleep for 6 seconds 00000100:00100000:2.0:1761240909.903076:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697408:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240909.903170:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697472:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761240909.904666:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000194716a4 going to sleep for 6 seconds 00000100:00100000:2.0:1761240909.914174:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697472:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761240909.915498:0:41801:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41801:1846792876697536:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761240909.915610:0:41801:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bc383f1e going to sleep for 6 seconds 00000100:00100000:2.0:1761240909.934714:0:41801:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41801:1846792876697536:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:2.0:1761240909.934782:0:41801:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1761240909.934798:0:41801:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1761240909.934800:0:41801:0:(obd_config.c:1460:class_process_config()) marker 347 (0x1) lustre-clilov add lustre.testpool2.lustre-OST0000_UUID 00000020:01000000:2.0:1761240909.934811:0:41801:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:2.0:1761240909.934828:0:41801:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1761240909.934845:0:41801:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool2 as member 1 00000100:00100000:2.0:1761240909.935001:0:41801:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41801:1846792876697600:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:2.0:1761240909.935118:0:41801:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bc383f1e going to sleep for 6 seconds 00000100:00100000:0.0:1761240909.939968:0:41801:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157f2833 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41801:1846792876697600:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:0.0:1761240909.940364:0:41801:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1761240909.940375:0:41801:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1761240909.940377:0:41801:0:(obd_config.c:1460:class_process_config()) marker 347 (0x2) lustre-clilov add lustre.testpool2.lustre-OST0000_UUID 00000040:00080000:0.0:1761240909.940383:0:41801:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 534 count 522 00000020:01000000:2.0:1761240909.940743:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 531-533 (rc=0) 10000000:01000000:2.0:1761240909.940769:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1761240909.940778:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240909.940793:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240909.940804:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1761240909.940806:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:2.0:1761240909.940809:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1761240909.940850:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240909.940858:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240909.940868:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240909.940896:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000373b74e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697664:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1761240909.942152:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000000910af0f going to sleep for 6 seconds 00000100:00100000:2.0:1761240909.952338:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000373b74e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697664:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240909.952377:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240909.952417:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240909.952515:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000373b74e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697728:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240909.952634:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000000910af0f going to sleep for 6 seconds 00000100:00100000:0.0:1761240909.965558:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000373b74e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876697728:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1761240909.965626:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1761240909.965637:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240909.965650:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240910.724427:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1761240911.743830:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240912.767451:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1761240912.909204:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240912.909213:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761240912.909216:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240912.909219:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1761240912.909423:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792876697792:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240912.909547:0:2215:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1761240912.909553:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe2741 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876697856:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240912.936598:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009346b37f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792876697792:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240912.936633:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f6fe2741 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876697856:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1761240913.081951:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240913.082058:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884571264 00000100:00100000:0.0:1761240913.082115:0:4986:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 294 00000100:00100000:0.0:1761240913.082123:0:4986:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f421c553 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45875:x1846792884571264:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240913.082138:0:4986:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240913.082223:0:4986:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240913.082228:0:4986:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f421c553 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45875:x1846792884571264:12345-192.168.206.106@tcp:104: Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240913.082234:0:4986:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 294 00010000:00010000:2.0:1761240913.085866:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1761240913.085889:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.085907:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009eac81e already unused, calling callback (00000000d1e5b923) 10000000:00010000:2.0:1761240913.085911:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.085921:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1761240913.085928:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240913.085933:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1761240913.086017:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.086025:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1761240913.086051:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.086058:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000009eac81e/0x39427fb11b5f264f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6156 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.086100:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240913.086102:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240913.086103:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240913.086375:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876697920:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1761240913.086796:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240913.086958:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884571328 00000100:00100000:0.0:1761240913.087005:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 295 00000100:00100000:0.0:1761240913.087012:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020f5b740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45875:x1846792884571328:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240913.087025:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240913.087136:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240913.087150:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020f5b740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:45875:x1846792884571328:12345-192.168.206.106@tcp:104: Request processed in 138us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240913.087158:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 295 00010000:00010000:2.0:1761240913.087837:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1761240913.087843:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.087853:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003107d5f3 already unused, calling callback (00000000d1e5b923) 10000000:00010000:2.0:1761240913.087856:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.087864:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1761240913.087871:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240913.087876:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1761240913.087919:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.087926:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1761240913.087951:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.087957:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 000000003107d5f3/0x39427fb11b5f2648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d614f expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240913.087975:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240913.087977:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240913.087979:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240913.088050:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037515b37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876697984:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1761240913.098314:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077269480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876697920:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1761240913.099166:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037515b37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876697984:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1761240913.800108:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1761240914.175349:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1761240914.175358:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 534 10000000:01000000:0.0:1761240914.175365:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1761240914.175420:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240914.175434:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240914.175445:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240914.175482:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bc52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698048:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761240914.175597:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000800c5eb1 going to sleep for 6 seconds 00000100:00100000:2.0:1761240914.187291:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bc52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698048:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240914.187330:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240914.187347:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240914.187452:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698112:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240914.187540:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c009dbcd going to sleep for 6 seconds 00000100:00100000:2.0:1761240914.189293:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698112:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240914.189348:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698176:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1761240914.190062:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c009dbcd going to sleep for 6 seconds 00000100:00100000:2.0:1761240914.196292:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698176:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1761240914.198192:0:41861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000071a9dc7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41861:1846792876698240:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:1.0:1761240914.198326:0:41861:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ab275644 going to sleep for 6 seconds 00000100:00100000:3.0:1761240914.206557:0:41861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000071a9dc7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41861:1846792876698240:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761240914.206622:0:41861:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1761240914.206635:0:41861:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761240914.206638:0:41861:0:(obd_config.c:1460:class_process_config()) marker 349 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1761240914.207341:0:41861:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:3.0:1761240914.207344:0:41861:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1761240914.207358:0:41861:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1761240914.207408:0:41861:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c15923ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41861:1846792876698304:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761240914.207522:0:41861:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ac1f2063 going to sleep for 6 seconds 00000100:00100000:3.0:1761240914.213584:0:41861:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c15923ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41861:1846792876698304:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761240914.213648:0:41861:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1761240914.213658:0:41861:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761240914.213660:0:41861:0:(obd_config.c:1460:class_process_config()) marker 349 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1761240914.213667:0:41861:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 537 count 525 00000020:01000000:1.0:1761240914.213749:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 534-536 (rc=0) 10000000:01000000:1.0:1761240914.213776:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1761240914.213786:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240914.213797:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1761240914.213807:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1761240914.213810:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:1.0:1761240914.213813:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1761240914.213851:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240914.213871:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240914.213894:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1761240914.213917:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002db7bf35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698368:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1761240914.214003:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b072e2cc going to sleep for 6 seconds 00000100:00100000:2.0:1761240914.218622:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002db7bf35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698368:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240914.218666:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240914.218682:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240914.218775:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698432:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240914.221554:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c009dbcd going to sleep for 6 seconds 00000100:00100000:2.0:1761240914.226566:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876698432:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1761240914.226636:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1761240914.226665:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240914.226679:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240914.823393:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240915.853738:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1761240916.264360:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761240916.264410:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240916.264506:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884574592 00000100:00100000:0.0:1761240916.264571:0:4986:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884574656 00000100:00100000:0.0:1761240916.264585:0:4986:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 296 00000100:00100000:0.0:1761240916.264592:0:4986:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002db7bf35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:46077:x1846792884574592:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240916.264614:0:4986:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.264706:0:4986:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240916.264712:0:4986:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002db7bf35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+4:46077:x1846792884574592:12345-192.168.206.106@tcp:104: Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240916.264719:0:4986:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 296 00000100:00100000:0.0:1761240916.264739:0:4986:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 297 00000100:00100000:0.0:1761240916.264762:0:4986:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000071a9dc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46077:x1846792884574656:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240916.264769:0:4986:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.264797:0:4986:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1761240916.264801:0:4986:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000071a9dc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46077:x1846792884574656:12345-192.168.206.106@tcp:104: Request processed in 39us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240916.264807:0:4986:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 297 00010000:00010000:3.0:1761240916.265689:0:4996:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1761240916.265696:0:4996:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265706:0:4996:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bd3f5caa already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240916.265710:0:4996:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265717:0:4996:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240916.265723:0:4996:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240916.265729:0:4996:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240916.265786:0:4996:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265792:0:4996:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240916.265813:0:4996:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265900:0:4996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000bd3f5caa/0x39427fb11b5f265d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d616b expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265930:0:4996:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240916.265933:0:4996:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265939:0:4996:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e60da18 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240916.265941:0:4996:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265946:0:4996:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240916.265951:0:4996:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240916.265956:0:4996:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240916.265969:0:4996:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265975:0:4996:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240916.265980:0:4996:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.265985:0:4996:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 000000002e60da18/0x39427fb11b5f2656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6164 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.266000:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240916.266001:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240916.266002:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240916.266011:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240916.266030:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c15923ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876698496:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1761240916.266112:0:2218:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1761240916.266118:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876698560:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1761240916.270345:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876698560:192.168.206.106@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1761240916.270366:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c15923ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876698496:192.168.206.106@tcp:103:ldlm_bl_01.0 00000080:00200000:1.0:1761240916.766198:0:41890:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761240916.766229:0:41890:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761240916.766364:0:41890:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240916.766380:0:41890:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761240916.766393:0:41890:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761240916.766397:0:41890:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761240916.766405:0:41890:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 000000009bbdd401 00010000:00010000:1.0:1761240916.766408:0:41890:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240916.766417:0:41890:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761240916.766436:0:41890:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 101 00000080:00200000:1.0:1761240916.766453:0:41890:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761240916.766458:0:41890:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761240916.766464:0:41890:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240916.766471:0:41890:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761240916.766477:0:41890:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761240916.766479:0:41890:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761240916.766482:0:41890:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 000000004069834d 00010000:00010000:1.0:1761240916.766484:0:41890:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240916.766489:0:41890:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761240916.766496:0:41890:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:1.0:1761240916.766508:0:41890:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), flags=1536 00000080:00200000:1.0:1761240916.766512:0:41890:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761240916.766516:0:41890:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761240916.766519:0:41890:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240916.766525:0:41890:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761240916.766532:0:41890:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761240916.766533:0:41890:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761240916.766542:0:41890:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 000000007242798b 00010000:00010000:1.0:1761240916.766543:0:41890:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240916.766549:0:41890:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761240916.766557:0:41890:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 3 00000080:00200000:1.0:1761240916.766562:0:41890:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:1.0:1761240916.766566:0:41890:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1761240916.766571:0:41890:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240916.766577:0:41890:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1761240916.766584:0:41890:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:1.0:1761240916.766586:0:41890:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:1.0:1761240916.766588:0:41890:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000ae2b1b3d 00010000:00010000:1.0:1761240916.766590:0:41890:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1761240916.766595:0:41890:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1761240916.766601:0:41890:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 3 00000080:00200000:1.0:1761240916.766606:0:41890:0:(namei.c:1898:ll_mkdir()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a) 00800000:00000004:1.0:1761240916.766625:0:41890:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff969f82c5a000: age 1369, max_age 0 00000100:00100000:0.0:1761240916.766730:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe2741 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876698624:192.168.206.106@tcp:41:mkdir.0 00000020:00100000:0.0:1761240916.776566:0:41890:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1761240916.776594:0:41890:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009209ffba x1846792876698752/t0(0) o36->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1761240916.776627:0:41890:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009209ffba pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41890:1846792876698752:192.168.206.106@tcp:36:mkdir.0 00000100:00100000:0.0:1761240916.779939:0:41890:0:(client.c:2500:ptlrpc_set_wait()) set 0000000044dbc2ac going to sleep for 31 seconds 00000100:00100000:0.0:1761240916.785771:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f6fe2741 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876698624:192.168.206.106@tcp:41:mkdir.0 00000100:00100000:0.0:1761240916.797227:0:41890:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009209ffba pname:cluuid:pid:xid:nid:opc:job mkdir:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41890:1846792876698752:192.168.206.106@tcp:36:mkdir.0 00000080:00200000:0.0:1761240916.797358:0:41890:0:(llite_lib.c:2833:ll_read_inode2()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43) 00000080:00200000:0.0:1761240916.797367:0:41890:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0xb82:0x0], updating i_size 512 00000080:00200000:0.0:1761240916.820410:0:41891:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:0.0:1761240916.820453:0:41891:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1761240916.820474:0:41891:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.820492:0:41891:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1761240916.820516:0:41891:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:0.0:1761240916.820520:0:41891:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:0.0:1761240916.820527:0:41891:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 000000001ba3400e 00010000:00010000:0.0:1761240916.820530:0:41891:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.820538:0:41891:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1761240916.820557:0:41891:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:0.0:1761240916.820574:0:41891:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:0.0:1761240916.820578:0:41891:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1761240916.820582:0:41891:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.820589:0:41891:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1761240916.820595:0:41891:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:0.0:1761240916.820597:0:41891:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:0.0:1761240916.820599:0:41891:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 000000001f148647 00010000:00010000:0.0:1761240916.820601:0:41891:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.820606:0:41891:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1761240916.820613:0:41891:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 3 00000080:00200000:0.0:1761240916.820623:0:41891:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), file 000000004631119b, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1761240916.820634:0:41891:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), intent=open|creat 00000002:00010000:0.0:1761240916.820655:0:41891:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x200000401:0xb83:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1761240916.821386:0:41891:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.821399:0:41891:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1761240916.821413:0:41891:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1761240916.821427:0:41891:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000055ba3d42 x1846792876698880/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1761240916.821436:0:41891:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240916.821463:0:41891:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055ba3d42 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41891:1846792876698880:192.168.206.106@tcp:101:lfs.0 00000100:00100000:0.0:1761240916.826605:0:41891:0:(client.c:2500:ptlrpc_set_wait()) set 0000000044dbc2ac going to sleep for 31 seconds 00000100:00100000:0.0:1761240916.837648:0:41891:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055ba3d42 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41891:1846792876698880:192.168.206.106@tcp:101:lfs.0 00010000:00010000:0.0:1761240916.837677:0:41891:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837694:0:41891:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837701:0:41891:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837709:0:41891:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837742:0:41891:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837749:0:41891:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003911b834 already unused, calling callback (0000000089d89e79) 00010000:00010000:0.0:1761240916.837753:0:41891:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837759:0:41891:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837767:0:41891:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837773:0:41891:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1761240916.837779:0:41891:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.837785:0:41891:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2664 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1761240916.837806:0:41891:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@0000000055ba3d42 x1846792876698880/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 528/600 e 0 to 0 dl 1761240948 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1761240916.837999:0:41891:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:0.0:1761240916.838017:0:41891:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1761240916.838032:0:41891:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.838043:0:41891:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1761240916.838058:0:41891:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:0.0:1761240916.838062:0:41891:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:0.0:1761240916.838070:0:41891:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 000000001ba3400e 00010000:00010000:0.0:1761240916.838072:0:41891:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.838079:0:41891:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1761240916.838107:0:41891:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:0.0:1761240916.838122:0:41891:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), file 00000000d24835fe, open_flags 1a100, mode 0 opened 0 00000080:00200000:0.0:1761240916.838130:0:41891:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), intent=open 00000002:00010000:0.0:1761240916.838142:0:41891:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0320401 00010000:00010000:0.0:1761240916.838193:0:41891:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.838200:0:41891:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1761240916.838212:0:41891:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1761240916.838217:0:41891:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000055ba3d42 x1846792876699008/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 528/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1761240916.838225:0:41891:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240916.838335:0:41891:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055ba3d42 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41891:1846792876699008:192.168.206.106@tcp:101:lfs.0 00000100:00100000:2.0:1761240916.838932:0:41891:0:(client.c:2500:ptlrpc_set_wait()) set 0000000044dbc2ac going to sleep for 31 seconds 00000100:00100000:2.0:1761240916.843285:0:41891:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055ba3d42 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41891:1846792876699008:192.168.206.106@tcp:101:lfs.0 00010000:00010000:2.0:1761240916.843318:0:41891:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843334:0:41891:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843342:0:41891:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843349:0:41891:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843358:0:41891:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843365:0:41891:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000018a489f8 already unused, calling callback (0000000089d89e79) 00010000:00010000:2.0:1761240916.843370:0:41891:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843377:0:41891:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843411:0:41891:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843419:0:41891:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1761240916.843426:0:41891:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.843432:0:41891:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000018a489f8/0x39427fb11b5f266b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41891 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1761240916.843454:0:41891:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@0000000055ba3d42 x1846792876699008/t4294976174(4294976174) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 528/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1761240916.843467:0:41891:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@0000000055ba3d42 x1846792876699008/t4294976174(4294976174) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 528/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1761240916.843507:0:41891:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0xb82:0x0], updating i_size 512 00000080:00200000:2.0:1761240916.843511:0:41891:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xb82:0x0](0000000047002b43): rc = 0 00000080:00010000:2.0:1761240916.843517:0:41891:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb82:0x0](0000000047002b43) for lock 0x0 00000080:00200000:2.0:1761240916.843544:0:41891:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), flags 320400 00000002:00100000:2.0:1761240916.843563:0:41891:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@0000000055ba3d42 x1846792876699008/t4294976174(4294976174) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 528/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1761240916.843703:0:41891:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), inode mode 41ed mask 44 00000080:00200000:2.0:1761240916.843757:0:41891:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), cmd=0x4008669a 00000020:00100000:2.0:1761240916.843836:0:41891:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1761240916.843843:0:41891:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b1f972a5 x1846792876699136/t0(0) o36->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1761240916.843874:0:41891:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41891:1846792876699136:192.168.206.106@tcp:36:lfs.0 00000100:00100000:2.0:1761240916.843977:0:41891:0:(client.c:2500:ptlrpc_set_wait()) set 000000000910af0f going to sleep for 31 seconds 00000100:00100000:2.0:1761240916.850533:0:41891:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1f972a5 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41891:1846792876699136:192.168.206.106@tcp:36:lfs.0 00000080:00200000:2.0:1761240916.850611:0:41891:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43) 00000002:00100000:2.0:1761240916.850661:0:41891:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@0000000055ba3d42 x1846792876699008/t4294976174(4294976174) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 528/600 e 0 to 0 dl 1761240948 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:2.0:1761240916.850693:0:41891:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1761240916.850699:0:41891:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e5f73941 x1846792876699264/t0(0) o35->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1761240916.850722:0:41891:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5f73941 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41891:1846792876699264:192.168.206.106@tcp:35:lfs.0 00000100:00100000:2.0:1761240916.850780:0:41891:0:(client.c:2500:ptlrpc_set_wait()) set 000000000910af0f going to sleep for 6 seconds 00000100:00100000:2.0:1761240916.854023:0:41891:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5f73941 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41891:1846792876699264:192.168.206.106@tcp:35:lfs.0 00000002:00100000:2.0:1761240916.854073:0:41891:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@0000000055ba3d42 x1846792876699008/t4294976174(4294976174) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 528/600 e 0 to 0 dl 1761240948 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:3.0:1761240916.866510:0:41892:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:3.0:1761240916.866549:0:41892:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1761240916.866571:0:41892:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.866590:0:41892:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1761240916.866603:0:41892:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:3.0:1761240916.866607:0:41892:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:3.0:1761240916.866618:0:41892:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000733d5a2d 00010000:00010000:3.0:1761240916.866621:0:41892:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.866630:0:41892:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1761240916.866649:0:41892:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:3.0:1761240916.866667:0:41892:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), file 0000000040dd0c2e, open_flags 18800, mode 0 opened 0 00000080:00200000:3.0:1761240916.866676:0:41892:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), intent=open 00000002:00010000:3.0:1761240916.866690:0:41892:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:3.0:1761240916.866758:0:41892:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240916.866773:0:41892:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1761240916.866789:0:41892:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1761240916.866803:0:41892:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c15923ce x1846792876699392/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1761240916.866811:0:41892:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761240916.866837:0:41892:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c15923ce pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699392:192.168.206.106@tcp:101:lfs.0 00000100:00100000:3.0:1761240916.867089:0:41892:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a751bba4 going to sleep for 31 seconds 00010000:00010000:2.0:1761240916.872041:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1761240916.885831:0:41892:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c15923ce pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699392:192.168.206.106@tcp:101:lfs.0 00010000:00010000:0.0:1761240916.885890:0:41892:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885908:0:41892:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885916:0:41892:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885923:0:41892:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885931:0:41892:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885938:0:41892:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000003dc17f8 already unused, calling callback (0000000089d89e79) 00010000:00010000:0.0:1761240916.885942:0:41892:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885950:0:41892:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885957:0:41892:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885965:0:41892:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1761240916.885971:0:41892:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.885977:0:41892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000003dc17f8/0x39427fb11b5f2672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1761240916.886004:0:41892:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@00000000c15923ce x1846792876699392/t4294976177(4294976177) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:0.0:1761240916.886017:0:41892:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000c15923ce x1846792876699392/t4294976177(4294976177) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1761240916.886057:0:41892:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0xb82:0x0], updating i_size 512 00000080:00200000:0.0:1761240916.886060:0:41892:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xb82:0x0](0000000047002b43): rc = 0 00000080:00010000:0.0:1761240916.886067:0:41892:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb82:0x0](0000000047002b43) for lock 0x0 00000080:00200000:0.0:1761240916.886093:0:41892:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), flags 304000 00000002:00100000:0.0:1761240916.886113:0:41892:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000c15923ce x1846792876699392/t4294976177(4294976177) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1761240916.886302:0:41892:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), inode mode 41ed mask 44 00000080:00200000:0.0:1761240916.886361:0:41892:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:0.0:1761240916.886380:0:41892:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1761240916.886395:0:41892:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.886408:0:41892:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1761240916.886420:0:41892:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:0.0:1761240916.886424:0:41892:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:0.0:1761240916.886429:0:41892:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 00000000733d5a2d 00010000:00010000:0.0:1761240916.886432:0:41892:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.886440:0:41892:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1761240916.886464:0:41892:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:0.0:1761240916.886482:0:41892:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), file 000000004a9bac8e, open_flags 28800, mode 0 opened 0 00000080:00200000:0.0:1761240916.886491:0:41892:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), intent=open 00000002:00010000:0.0:1761240916.886505:0:41892:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0504001 00010000:00010000:0.0:1761240916.886564:0:41892:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.886574:0:41892:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1761240916.886587:0:41892:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1761240916.886593:0:41892:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000031e9591b x1846792876699520/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1761240916.886601:0:41892:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240916.886626:0:41892:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699520:192.168.206.106@tcp:101:lfs.0 00000100:00100000:0.0:1761240916.886774:0:41892:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b6a981d6 going to sleep for 31 seconds 00000100:00100000:0.0:1761240916.905591:0:41892:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699520:192.168.206.106@tcp:101:lfs.0 00010000:00010000:0.0:1761240916.905623:0:41892:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905642:0:41892:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905650:0:41892:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905671:0:41892:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905680:0:41892:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905687:0:41892:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003911b834 already unused, calling callback (0000000089d89e79) 00010000:00010000:0.0:1761240916.905691:0:41892:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905698:0:41892:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905707:0:41892:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905714:0:41892:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1761240916.905720:0:41892:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240916.905727:0:41892:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003911b834/0x39427fb11b5f2679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41892 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1761240916.905750:0:41892:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@0000000031e9591b x1846792876699520/t4294976178(4294976178) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:0.0:1761240916.905764:0:41892:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@0000000031e9591b x1846792876699520/t4294976178(4294976178) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1761240916.905804:0:41892:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0xb82:0x0], updating i_size 512 00000080:00200000:0.0:1761240916.905814:0:41892:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xb82:0x0](0000000047002b43): rc = 0 00000080:00010000:0.0:1761240916.905838:0:41892:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb82:0x0](0000000047002b43) for lock 0x0 00000080:00200000:0.0:1761240916.905880:0:41892:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), flags 504000 00000002:00100000:0.0:1761240916.905902:0:41892:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@0000000031e9591b x1846792876699520/t4294976178(4294976178) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:0.0:1761240916.905928:0:41892:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@0000000031e9591b x1846792876699520/t4294976178(4294976178) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:0.0:1761240916.905958:0:41892:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1761240916.905964:0:41892:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000000c59875 x1846792876699648/t0(0) o35->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1761240916.905987:0:41892:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000c59875 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699648:192.168.206.106@tcp:35:lfs.0 00000100:00100000:0.0:1761240916.906072:0:41892:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b6a981d6 going to sleep for 6 seconds 00000100:00100000:0.0:1761240916.919631:0:41892:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000c59875 pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699648:192.168.206.106@tcp:35:lfs.0 00000002:00100000:0.0:1761240916.919678:0:41892:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@0000000031e9591b x1846792876699520/t4294976178(4294976178) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1761240916.919886:0:41892:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), inode mode 41ed mask 44 00000080:00200000:0.0:1761240916.919943:0:41892:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43) 00000080:00200000:0.0:1761240916.919993:0:41892:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), cmd=0x4008669b 00000100:00100000:0.0:1761240916.920066:0:41892:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699712:192.168.206.106@tcp:33:lfs.0 00000100:00100000:0.0:1761240916.920165:0:41892:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b6a981d6 going to sleep for 31 seconds 00000100:00100000:0.0:1761240916.923178:0:41892:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699712:192.168.206.106@tcp:33:lfs.0 00000080:00200000:0.0:1761240916.923438:0:41892:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43) 00000002:00100000:0.0:1761240916.923480:0:41892:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@00000000c15923ce x1846792876699392/t4294976177(4294976177) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:0.0:1761240916.923509:0:41892:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1761240916.923520:0:41892:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000031e9591b x1846792876699840/t0(0) o35->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1761240916.923542:0:41892:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699840:192.168.206.106@tcp:35:lfs.0 00000100:00100000:0.0:1761240916.923611:0:41892:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b6a981d6 going to sleep for 6 seconds 00000100:00100000:0.0:1761240916.932524:0:41892:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job lfs:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41892:1846792876699840:192.168.206.106@tcp:35:lfs.0 00000002:00100000:0.0:1761240916.932568:0:41892:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@00000000c15923ce x1846792876699392/t4294976177(4294976177) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:2.0:1761240916.964605:0:41893:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a),name=/ 00000002:00010000:2.0:1761240916.964648:0:41893:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1761240916.964672:0:41893:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.964689:0:41893:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1761240916.964702:0:41893:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) 00000080:00010000:2.0:1761240916.964706:0:41893:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](00000000c15e484a) for lock 0x39427fb11b5ec9ea 00000080:00010000:2.0:1761240916.964714:0:41893:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5ec9ea from it 000000001ba3400e 00010000:00010000:2.0:1761240916.964718:0:41893:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.964733:0:41893:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000036521712/0x39427fb11b5ec9ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c649f6a3 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1761240916.964751:0:41893:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](00000000c15e484a), inode mode 41ed mask 1 00000080:00200000:2.0:1761240916.964767:0:41893:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), flags=25 00000080:00200000:2.0:1761240916.964773:0:41893:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](00000000c15e484a), intent=0 00000002:00010000:2.0:1761240916.964786:0:41893:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1761240916.964844:0:41893:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.964852:0:41893:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.964876:0:41893:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240916.964909:0:41893:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5f73941 pname:cluuid:pid:xid:nid:opc:job createmany:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41893:1846792876699904:192.168.206.106@tcp:101:createmany.0 00000100:00100000:2.0:1761240916.965023:0:41893:0:(client.c:2500:ptlrpc_set_wait()) set 000000000910af0f going to sleep for 31 seconds 00000100:00100000:2.0:1761240916.974453:0:41893:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5f73941 pname:cluuid:pid:xid:nid:opc:job createmany:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41893:1846792876699904:192.168.206.106@tcp:101:createmany.0 00010000:00010000:2.0:1761240916.974488:0:41893:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974515:0:41893:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974524:0:41893:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974558:0:41893:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974569:0:41893:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974582:0:41893:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974588:0:41893:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974595:0:41893:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1761240916.974605:0:41893:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@00000000e5f73941 x1846792876699904/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 584/640 e 0 to 0 dl 1761240948 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'createmany.0' 00000002:00010000:2.0:1761240916.974618:0:41893:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974628:0:41893:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 00000000753932f7 type 13 mode 4 res 8589935617/2946 (0 0) 00000080:00200000:2.0:1761240916.974658:0:41893:0:(llite_lib.c:2755:ll_update_inode()) inode=[0x200000401:0xb82:0x0], updating i_size 512 00000080:00200000:2.0:1761240916.974661:0:41893:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0xb82:0x0](0000000047002b43): rc = 0 00000080:00010000:2.0:1761240916.974669:0:41893:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb82:0x0](0000000047002b43) for lock 0x39427fb11b5f2680 00000080:00010000:2.0:1761240916.974681:0:41893:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xb82:0x0](0000000047002b43) 00000080:00010000:2.0:1761240916.974685:0:41893:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x39427fb11b5f2680 from it 0000000034428750 00010000:00010000:2.0:1761240916.974687:0:41893:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974701:0:41893:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 000000003107d5f3/0x39427fb11b5f2680 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb82:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x998704a8c64d62d0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1761240916.974739:0:41893:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), inode mode 41ed mask 1 00000080:00200000:2.0:1761240916.974761:0:41893:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000401:0xb82:0x0](0000000047002b43), inode mode 41ed mask 3 00000080:00200000:2.0:1761240916.974766:0:41893:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f22.ost-pools0, dir=[0x200000401:0xb82:0x0](0000000047002b43), file 00000000867f35b6, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1761240916.974776:0:41893:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22.ost-pools0, dir=[0x200000401:0xb82:0x0](0000000047002b43), intent=open|creat 00000002:00010000:2.0:1761240916.974802:0:41893:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22.ost-pools0,[0x200000401:0xb84:0x0]) in obj [0x200000401:0xb82:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1761240916.974855:0:41893:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240916.974872:0:41893:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1761240916.974884:0:41893:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff969f82c5a000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1761240916.974890:0:41893:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e5f73941 x1846792876700032/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1761240916.974898:0:41893:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240916.974919:0:41893:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5f73941 pname:cluuid:pid:xid:nid:opc:job createmany:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41893:1846792876700032:192.168.206.106@tcp:101:createmany.0 00000100:00100000:2.0:1761240916.976080:0:41893:0:(client.c:2500:ptlrpc_set_wait()) set 000000000910af0f going to sleep for 31 seconds 10000000:01000000:0.0:1761240917.695329:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1761240917.695339:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 537 10000000:01000000:0.0:1761240917.695346:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1761240917.695405:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240917.695418:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240917.695429:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240917.695463:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700096:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1761240917.695579:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b6a981d6 going to sleep for 6 seconds 00000100:00100000:0.0:1761240917.702145:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700096:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1761240917.702197:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240917.702215:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1761240917.702425:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700160:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240917.702508:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b6a981d6 going to sleep for 6 seconds 00000100:00100000:0.0:1761240917.708037:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700160:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1761240917.708126:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700224:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1761240917.709467:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b6a981d6 going to sleep for 6 seconds 00000100:00100000:0.0:1761240917.717313:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700224:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1761240917.720088:0:41911:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41911:1846792876700288:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:0.0:1761240917.722699:0:41911:0:(client.c:2500:ptlrpc_set_wait()) set 000000000f8e48a4 going to sleep for 6 seconds 00000100:00100000:0.0:1761240917.728694:0:41911:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41911:1846792876700288:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:0.0:1761240917.728768:0:41911:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1761240917.728782:0:41911:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1761240917.728785:0:41911:0:(obd_config.c:1460:class_process_config()) marker 351 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:0.0:1761240917.728793:0:41911:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:0.0:1761240917.728796:0:41911:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1761240917.728810:0:41911:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000100:00100000:0.0:1761240917.728866:0:41911:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41911:1846792876700352:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:0.0:1761240917.728980:0:41911:0:(client.c:2500:ptlrpc_set_wait()) set 000000000f8e48a4 going to sleep for 6 seconds 00000100:00100000:0.0:1761240917.738944:0:41911:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41911:1846792876700352:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:0.0:1761240917.739025:0:41911:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1761240917.739038:0:41911:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1761240917.739041:0:41911:0:(obd_config.c:1460:class_process_config()) marker 351 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000040:00080000:0.0:1761240917.739047:0:41911:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 540 count 528 00000020:01000000:2.0:1761240917.740099:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 537-539 (rc=0) 10000000:01000000:2.0:1761240917.740142:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1761240917.740153:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240917.740184:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240917.740198:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1761240917.740200:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:2.0:1761240917.740204:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1761240917.740269:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240917.740276:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240917.740286:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240917.740314:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c01432ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700416:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1761240917.740422:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bc383f1e going to sleep for 6 seconds 00000100:00100000:2.0:1761240917.764446:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c01432ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700416:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240917.764493:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240917.764509:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240917.764621:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c01432ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700480:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240917.764714:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bc383f1e going to sleep for 6 seconds 00000100:00100000:2.0:1761240917.769426:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c01432ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700480:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1761240917.769511:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1761240917.769520:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240917.769532:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240917.890596:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1761240918.028146:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1761240918.028154:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1761240918.028156:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1761240918.028159:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1761240918.028170:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000c59875 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876700608:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1761240918.028192:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876700544:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1761240918.048016:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e9591b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876700544:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1761240918.055529:0:2215:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff969f82c5a000: committing for last_committed 4294976180 gen 1 00000100:00100000:0.0:1761240918.055561:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000c59875 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876700608:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1761240918.169548:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240918.169704:0:18415:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884577344 00000100:00100000:0.0:1761240918.169776:0:18415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 298 00000100:00100000:0.0:1761240918.169784:0:18415:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009346b37f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46226:x1846792884577344:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240918.169803:0:18415:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240918.169917:0:18415:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240918.169923:0:18415:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009346b37f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46226:x1846792884577344:12345-192.168.206.106@tcp:104: Request processed in 139us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240918.169931:0:18415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 298 00010000:00010000:3.0:1761240918.170375:0:9740:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1761240918.170383:0:9740:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240918.170392:0:9740:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a784a737 already unused, calling callback (00000000d1e5b923) 10000000:00010000:3.0:1761240918.170395:0:9740:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240918.170404:0:9740:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1761240918.170411:0:9740:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1761240918.170416:0:9740:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1761240918.170473:0:9740:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240918.170502:0:9740:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1761240918.170527:0:9740:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240918.170532:0:9740:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000a784a737/0x39427fb11b5f2695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d62f3 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240918.170548:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240918.170550:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1761240918.170551:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240918.170570:0:2218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876700672:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1761240918.173213:0:2204:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761240918.174500:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884577408 00000100:00100000:1.0:1761240918.174575:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 299 00000100:00100000:1.0:1761240918.174583:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000c59875 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46226:x1846792884577408:12345-192.168.206.106@tcp:104: 00010000:00010000:1.0:1761240918.174604:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240918.177303:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1761240918.177317:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240918.177335:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003911b834 already unused, calling callback (00000000d1e5b923) 10000000:00010000:2.0:1761240918.177339:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240918.177348:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1761240918.177355:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240918.177360:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1761240918.177419:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240918.177425:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1761240918.177445:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240918.177450:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 000000003911b834/0x39427fb11b5f268e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d62ec expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240918.177489:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240918.177491:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240918.177492:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1761240918.177569:0:2217:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c01432ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876700736:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1761240918.178265:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1761240918.178279:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000c59875 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46226:x1846792884577408:12345-192.168.206.106@tcp:104: Request processed in 3693us (5074us total) trans 0 rc 0/0 00000100:00100000:1.0:1761240918.178293:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 299 00000100:00100000:3.0:1761240918.181784:0:2218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2218:1846792876700672:192.168.206.106@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1761240918.186285:0:2217:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c01432ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2217:1846792876700736:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1761240918.914348:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1761240919.936364:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1761240920.127415:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1761240920.127427:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff969f82c5a000 from 540 10000000:01000000:3.0:1761240920.127434:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1761240920.127498:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240920.127512:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240920.127524:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761240920.127557:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700800:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1761240920.127780:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000004dbd1b83 going to sleep for 6 seconds 00000100:00100000:3.0:1761240920.139378:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700800:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1761240920.139417:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1761240920.139433:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1761240920.139535:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700864:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1761240920.139992:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000004dbd1b83 going to sleep for 6 seconds 00000100:00100000:3.0:1761240920.142351:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700864:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1761240920.142421:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700928:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1761240920.142542:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000004dbd1b83 going to sleep for 6 seconds 00000100:00100000:3.0:1761240920.146719:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876700928:192.168.206.106@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1761240920.148613:0:41939:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41939:1846792876700992:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761240920.148731:0:41939:0:(client.c:2500:ptlrpc_set_wait()) set 00000000df03ed76 going to sleep for 6 seconds 00000100:00100000:3.0:1761240920.156383:0:41939:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41939:1846792876700992:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761240920.156451:0:41939:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1761240920.156466:0:41939:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761240920.156468:0:41939:0:(obd_config.c:1460:class_process_config()) marker 353 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1761240920.156478:0:41939:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff969f82c5a000 00000020:00000080:3.0:1761240920.156481:0:41939:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1761240920.156705:0:41939:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1761240920.156758:0:41939:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41939:1846792876701056:192.168.206.106@tcp:502:llog_process_th.0 00000100:00100000:3.0:1761240920.156880:0:41939:0:(client.c:2500:ptlrpc_set_wait()) set 00000000df03ed76 going to sleep for 6 seconds 00000100:00100000:3.0:1761240920.168347:0:41939:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080e9ff35 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:41939:1846792876701056:192.168.206.106@tcp:502:llog_process_th.0 00000020:01000000:3.0:1761240920.168417:0:41939:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1761240920.168431:0:41939:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1761240920.168433:0:41939:0:(obd_config.c:1460:class_process_config()) marker 353 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1761240920.168440:0:41939:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 543 count 531 00000020:01000000:2.0:1761240920.169454:0:5000:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 540-542 (rc=0) 10000000:01000000:2.0:1761240920.169489:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1761240920.169499:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240920.169513:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1761240920.169524:0:5000:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1761240920.169527:0:5000:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff969f8923be88 from 1 10000000:01000000:2.0:1761240920.169531:0:5000:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1761240920.169576:0:5000:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240920.169584:0:5000:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240920.169594:0:5000:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240920.169622:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067878c0c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876701120:192.168.206.106@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1761240920.169729:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009796b4fd going to sleep for 6 seconds 00000100:00100000:2.0:1761240920.172981:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067878c0c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876701120:192.168.206.106@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1761240920.173020:0:5000:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240920.173056:0:5000:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1761240920.173155:0:5000:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067878c0c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876701184:192.168.206.106@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1761240920.173266:0:5000:0:(client.c:2500:ptlrpc_set_wait()) set 000000009796b4fd going to sleep for 6 seconds 00000100:00100000:2.0:1761240920.180164:0:5000:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067878c0c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:5000:1846792876701184:192.168.206.106@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1761240920.180227:0:5000:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1761240920.180237:0:5000:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240920.180293:0:5000:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240920.960563:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240921.983812:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1761240923.007454:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1761240923.135494:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240923.135502:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761240923.135505:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240923.135508:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1761240923.135581:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000b00089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876701248:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240923.135704:0:2216:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1761240923.135711:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ee2b862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792876701312:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1761240923.139913:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000b00089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876701248:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240923.143460:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ee2b862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792876701312:192.168.206.106@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1761240924.033936:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240925.057682:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1761240926.079588:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240927.104106:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240928.127456:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1761240928.255459:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1761240928.255477:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1761240928.255480:0:30544:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1761240928.255483:0:30544:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1761240928.255488:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009209ffba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876701376:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1761240928.255508:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033b5bb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876701440:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1761240928.259683:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033b5bb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876701440:192.168.206.106@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1761240928.259773:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009209ffba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876701376:192.168.206.106@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1761240929.151490:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240930.175485:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240931.200101:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1761240932.223443:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240933.248855:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1761240933.375527:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240933.375534:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761240933.375536:0:36:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240933.375539:0:36:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1761240933.375569:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000820a7c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876701568:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1761240933.375652:0:2215:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1761240933.375659:0:2215:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000b00089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792876701504:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240933.386591:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000b00089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2215:1846792876701504:192.168.206.106@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1761240933.386608:0:2215:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000820a7c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2215:1846792876701568:192.168.206.106@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1761240934.271459:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1761240935.295352:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1761240936.319481:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1761240937.056966:0:41893:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5f73941 pname:cluuid:pid:xid:nid:opc:job createmany:4ffd2023-cacd-4e39-8a6e-05d927860e2a:41893:1846792876700032:192.168.206.106@tcp:101:createmany.0 00010000:00010000:2.0:1761240937.056992:0:41893:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057023:0:41893:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057030:0:41893:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057036:0:41893:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 3/0,0 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057044:0:41893:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057049:0:41893:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009eac81e already unused, calling callback (0000000089d89e79) 00010000:00010000:2.0:1761240937.057053:0:41893:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057059:0:41893:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 4/0,0 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057066:0:41893:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 5/0,0 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057073:0:41893:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1761240937.057078:0:41893:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 3/0,0 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240937.057084:0:41893:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff969f82c5a000 lock: 0000000009eac81e/0x39427fb11b5f2687 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb82:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 41893 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1761240937.057116:0:41893:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=17, status=-28 req@00000000e5f73941 x1846792876700032/t0(0) o101->lustre-MDT0000-mdc-ffff969f82c5a000@192.168.206.106@tcp:12/10 lens 656/600 e 0 to 0 dl 1761240948 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'createmany.0' 00000080:00200000:2.0:1761240937.057202:0:41893:0:(namei.c:1405:ll_create_it()) VFS Op:name=f22.ost-pools0, dir=[0x200000401:0xb82:0x0](0000000047002b43), intent=open|creat 00010000:00010000:2.0:1761240937.348962:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1761240938.004625:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:1.0:1761240938.004690:0:2205:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.106@tcp (source: 12345-192.168.206.106@tcp) 00000100:00100000:0.0:1761240938.004789:0:4987:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1761240938.004826:0:4987:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884581632 00000100:00100000:0.0:1761240938.004898:0:4987:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 300 00000100:00100000:0.0:1761240938.004907:0:4987:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6fad5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46490:x1846792884581632:12345-192.168.206.106@tcp:104: 00010000:00010000:0.0:1761240938.004928:0:4987:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005013:0:4987:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1761240938.005020:0:4987:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6fad5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46490:x1846792884581632:12345-192.168.206.106@tcp:104: Request processed in 113us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1761240938.005028:0:4987:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 300 00000100:00100000:2.0:1761240938.005120:0:4988:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1846792884581696 00000100:00100000:2.0:1761240938.005155:0:4988:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.106@tcp, seq: 17 00000100:00100000:2.0:1761240938.005160:0:4988:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000012f87d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46490:x1846792884581696:12345-192.168.206.106@tcp:104: 00010000:00010000:2.0:1761240938.005168:0:4988:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1761240938.005219:0:4988:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1761240938.005224:0:4988:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000012f87d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868+3:46490:x1846792884581696:12345-192.168.206.106@tcp:104: Request processed in 64us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1761240938.005232:0:4988:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.106@tcp, seq: 17 00010000:00010000:0.0:1761240938.005339:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1761240938.005345:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005355:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c9228a41 already unused, calling callback (00000000d1e5b923) 10000000:00010000:0.0:1761240938.005368:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005377:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1761240938.005385:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1761240938.005391:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1761240938.005447:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005455:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1761240938.005478:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005485:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 00000000c9228a41/0x39427fb11b5f26a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d635c expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005499:0:4997:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1761240938.005502:0:4997:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005508:0:4997:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000026a1292a already unused, calling callback (00000000d1e5b923) 10000000:00010000:0.0:1761240938.005510:0:4997:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005515:0:4997:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1761240938.005520:0:4997:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1761240938.005537:0:4997:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1761240938.005551:0:4997:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005557:0:4997:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1761240938.005562:0:4997:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005568:0:4997:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.106@tcp lock: 0000000026a1292a/0x39427fb11b5f269c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998704a8c64d6355 expref: -99 pid: 5000 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1761240938.005582:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1761240938.005583:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1761240938.005585:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1761240938.005607:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020f5b740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876701632:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1761240938.005660:0:2216:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1761240938.005666:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000c59875 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876701696:192.168.206.106@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1761240938.005968:0:9740:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1761240938.008282:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000c59875 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876701696:192.168.206.106@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1761240938.008307:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020f5b740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ada9a5c-205f-4c6c-bcb7-adc5ca0ec868:2216:1846792876701632:192.168.206.106@tcp:103:ldlm_bl_02.0 00000400:00000080:0.0:1761240938.324610:0:42087:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1761240938.324620:0:42087:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: ost-pools test_22: @@@@@@ FAIL: createmany /mnt/lustre/d22.ost-pools/f22.ost-pools failed! 00010000:00010000:0.0:1761240938.370992:0:4996:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1761240938.495390:0:40653:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240938.495400:0:40653:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1761240938.495403:0:40653:0:(pinger.c:251:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1761240938.495406:0:40653:0:(pinger.c:265:ptlrpc_pinger_process_import()) 4ffd2023-cacd-4e39-8a6e-05d927860e2a->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1761240938.496182:0:2216:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822101cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792876701760:192.168.206.106@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1761240938.509573:0:2216:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822101cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ffd2023-cacd-4e39-8a6e-05d927860e2a:2216:1846792876701760:192.168.206.106@tcp:400:kworker/u8:4.0 00010000:00010000:3.0:1761240939.393067:0:4997:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1498 lines, 1498 kept, 0 dropped, 0 bad.