00000100:00080000:2.0F:1747400965.339411:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400965.339419:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747400965.339421:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400965.339423:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0F:1747400965.339432:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085808000:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400965.339436:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281085808064:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400965.340503:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085808000:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400965.340530:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281085808064:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747400966.107461:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1747400966.405744:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400966.405798:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0F:1747400966.405851:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090203968 00000100:00100000:0.0:1747400966.405851:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1747400966.405868:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090204096 00000100:00100000:1.0:1747400966.405905:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 264 00000100:00100000:1.0:1747400966.405910:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:30040:x1832281090203968:12345-192.168.204.160@tcp:104: 00000100:00100000:0.0:1747400966.405912:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 265 00000100:00100000:0.0:1747400966.405917:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:30040:x1832281090204096:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400966.405921:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf1524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb774 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400966.405927:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abf151d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb76d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400966.405981:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747400966.405986:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:30040:x1832281090204096:12345-192.168.204.160@tcp:104: Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1747400966.405991:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 265 00010000:00010000:1.0:1747400966.406001:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747400966.406006:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:30040:x1832281090203968:12345-192.168.204.160@tcp:104: Request processed in 96us (268us total) trans 0 rc 0/0 00010000:00010000:3.0:1747400966.406010:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1747400966.406012:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 264 00010000:00010000:3.0:1747400966.406016:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abf151d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb76d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400966.406022:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45a640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747400966.406025:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abf151d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bb76d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400966.406031:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abf151d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bb76d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747400966.406036:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abf151d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bb76d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400966.406038:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1747400966.406040:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747400966.406042:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf1524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb774 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400966.406048:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d6640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400966.406051:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf1524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bb774 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400966.406057:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf1524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bb774 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400966.406062:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf1524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bb774 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400966.406066:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747400966.406072:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abf151d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb76d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400966.406077:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747400966.406092:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf1524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb774 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400966.406093:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abf151d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb76d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400966.406097:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400966.406098:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45a640/0xd95e55596abf151d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb76d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400966.406104:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf1524 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb774 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400966.406107:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf1524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb774 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400966.406119:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400966.406120:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400966.406126:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400966.406136:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400966.406137:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400966.406139:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747400966.406141:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085808128:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747400966.406159:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085808192:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747400966.406873:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085808128:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747400966.406931:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085808192:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1747400967.109527:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747400967.776424:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747400967.776432:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 515 10000000:01000000:1.0:1747400967.776438:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747400967.776482:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400967.776492:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400967.776501:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400967.776526:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808256:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747400967.776610:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747400967.777878:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808256:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747400967.777895:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400967.777902:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400967.777953:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808320:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747400967.777984:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747400967.778883:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808320:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747400967.778908:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808384:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747400967.778947:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747400967.779726:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808384:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747400967.779997:0:12703:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:12703:1832281085808448:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747400967.780056:0:12703:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747400967.780963:0:12703:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:12703:1832281085808448:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747400967.780988:0:12703:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747400967.780995:0:12703:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747400967.780996:0:12703:0:(obd_config.c:1460:class_process_config()) marker 337 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:1.0:1747400967.781001:0:12703:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747400967.781002:0:12703:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1747400967.781011:0:12703:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:1.0:1747400967.781025:0:12703:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:12703:1832281085808512:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747400967.781063:0:12703:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747400967.781865:0:12703:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:12703:1832281085808512:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747400967.781879:0:12703:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747400967.781882:0:12703:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747400967.781883:0:12703:0:(obd_config.c:1460:class_process_config()) marker 337 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:1.0:1747400967.781886:0:12703:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 518 count 507 00000020:01000000:2.0:1747400967.781947:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 515-517 (rc=0) 10000000:01000000:2.0:1747400967.781965:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400967.781972:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400967.781980:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400967.781987:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400967.781989:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400967.781991:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400967.782007:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400967.782012:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400967.782019:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400967.782029:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400967.782058:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e600 going to sleep for 6 seconds 00000100:00100000:2.0:1747400967.782797:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808576:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400967.782812:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400967.782818:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400967.782848:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808640:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400967.782870:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e600 going to sleep for 6 seconds 00000100:00100000:2.0:1747400967.783497:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808640:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400967.783511:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400967.783513:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400967.783519:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400968.111512:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747400968.854496:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400968.854552:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400968.854571:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090205952 00000100:00100000:1.0:1747400968.854606:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090206016 00000100:00100000:1.0:1747400968.854616:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 266 00000100:00100000:1.0:1747400968.854620:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:30200:x1832281090205952:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400968.854633:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400968.854701:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747400968.854706:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:30200:x1832281090205952:12345-192.168.204.160@tcp:104: Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400968.854713:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 266 00000100:00100000:0.0:1747400968.854725:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 267 00010000:00010000:2.0:1747400968.854727:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747400968.854731:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400968.854733:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:30200:x1832281090206016:12345-192.168.204.160@tcp:104: 00010000:00010000:2.0:1747400968.854738:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d6640 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400968.854740:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400968.854743:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400968.854745:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400968.854749:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400968.854766:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747400968.854806:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1747400968.854810:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400968.854811:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:30200:x1832281090206016:12345-192.168.204.160@tcp:104: Request processed in 79us (260us total) trans 0 rc 0/0 00010000:00010000:1.0:1747400968.854814:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747400968.854815:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747400968.854817:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400968.854817:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 267 00010000:00010000:1.0:1747400968.854822:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747400968.854824:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400968.854829:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400968.854829:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747400968.854833:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400968.854834:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d6640/0xd95e55596abf157f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb988 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747400968.854837:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1747400968.854846:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085808704:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747400968.854848:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400968.854849:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400968.854850:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747400968.854863:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400968.854868:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747400968.854883:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400968.854894:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abf1578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb981 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400968.854918:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747400968.854918:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747400968.854920:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747400968.854924:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281085808768:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747400968.855615:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085808704:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1747400968.855644:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281085808768:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747400969.113465:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747400969.577421:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747400969.577426:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 518 10000000:01000000:3.0:1747400969.577430:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747400969.577467:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400969.577475:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400969.577483:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400969.577502:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808832:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747400969.577565:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747400969.578697:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808832:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747400969.578708:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400969.578715:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400969.578771:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808896:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747400969.578801:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747400969.579436:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808896:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747400969.579472:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808960:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400969.579529:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747400969.580174:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085808960:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747400969.580443:0:12722:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:12722:1832281085809024:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747400969.580488:0:12722:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34cc0 going to sleep for 6 seconds 00000100:00100000:1.0:1747400969.581300:0:12722:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:12722:1832281085809024:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747400969.581354:0:12722:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747400969.581360:0:12722:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747400969.581361:0:12722:0:(obd_config.c:1460:class_process_config()) marker 339 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:1.0:1747400969.581366:0:12722:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747400969.581368:0:12722:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1747400969.581404:0:12722:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:12722:1832281085809088:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747400969.581433:0:12722:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:1.0:1747400969.582075:0:12722:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:12722:1832281085809088:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747400969.582091:0:12722:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747400969.582094:0:12722:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747400969.582095:0:12722:0:(obd_config.c:1460:class_process_config()) marker 339 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:1.0:1747400969.582097:0:12722:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 521 count 510 00000020:01000000:3.0:1747400969.582145:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 518-520 (rc=0) 10000000:01000000:3.0:1747400969.582158:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1747400969.582161:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400969.582167:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747400969.582172:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1747400969.582173:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:3.0:1747400969.582174:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1747400969.582184:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400969.582187:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400969.582191:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400969.582197:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809152:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747400969.582228:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747400969.582782:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809152:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747400969.582791:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400969.582797:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400969.582823:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809216:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747400969.582845:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747400969.583345:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809216:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1747400969.583366:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1747400969.583371:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400969.583379:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400970.115383:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747400970.347499:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400970.347505:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747400970.347507:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400970.347509:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747400970.347537:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085809280:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400970.347537:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085809344:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400970.348730:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085809280:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400970.348754:0:1865:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294998777 gen 1 00000100:00100000:2.0:1747400970.348766:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085809344:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:1.0:1747400971.117452:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1747400971.624220:0:13009:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1747400971.624223:0:13009:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 22: Simultaneous manipulation of a pool ========================================================== 09:09:31 (1747400971) 00000100:00100000:0.0:1747400971.865416:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400971.865458:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400971.865488:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090209216 00000100:00100000:0.0:1747400971.865493:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090209280 00000100:00100000:0.0:1747400971.865518:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 268 00000100:00100000:0.0:1747400971.865523:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:30744:x1832281090209216:12345-192.168.204.160@tcp:104: 00000100:00100000:1.0:1747400971.865526:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 269 00000100:00100000:1.0:1747400971.865530:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:30744:x1832281090209280:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400971.865536:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400971.865536:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400971.865584:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747400971.865590:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:30744:x1832281090209280:12345-192.168.204.160@tcp:104: Request processed in 59us (132us total) trans 0 rc 0/0 00010000:00010000:0.0:1747400971.865592:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747400971.865595:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 269 00000100:00100000:0.0:1747400971.865596:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:30744:x1832281090209216:12345-192.168.204.160@tcp:104: Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1747400971.865600:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 268 00010000:00010000:3.0:1747400971.865611:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747400971.865615:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400971.865619:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747400971.865620:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e2acd80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747400971.865621:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400971.865622:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400971.865630:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747400971.865633:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747400971.865635:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747400971.865635:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e2acfc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400971.865637:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400971.865642:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400971.865646:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400971.865650:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747400971.865657:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400971.865659:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747400971.865665:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400971.865669:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400971.865670:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400971.865672:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e2acd80/0xd95e55596abf1586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb9f8 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400971.865674:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400971.865678:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e2acfc0/0xd95e55596abf158d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bb9ff expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400971.865685:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400971.865686:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400971.865687:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400971.865692:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400971.865693:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400971.865694:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747400971.865697:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085809408:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747400971.865703:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085809472:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747400971.866352:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085809408:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747400971.866375:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085809472:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1747400972.119449:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747400973.090421:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747400973.090425:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 521 10000000:01000000:2.0:1747400973.090428:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747400973.090462:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400973.090469:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400973.090475:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400973.090490:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809536:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400973.090541:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ef00 going to sleep for 6 seconds 00000100:00100000:2.0:1747400973.091538:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809536:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400973.091550:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400973.091557:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400973.091594:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809600:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400973.091622:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ef00 going to sleep for 6 seconds 00000100:00100000:2.0:1747400973.092378:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809600:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400973.092395:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809664:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747400973.092429:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ef00 going to sleep for 6 seconds 00000100:00100000:2.0:1747400973.093103:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809664:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400973.093298:0:13040:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13040:1832281085809728:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400973.093347:0:13040:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05000 going to sleep for 6 seconds 00000100:00100000:3.0:1747400973.094303:0:13040:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13040:1832281085809728:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400973.094334:0:13040:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400973.094340:0:13040:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400973.094345:0:13040:0:(obd_config.c:1460:class_process_config()) marker 341 (0x1) lustre-clilov new lustre.testpool 00000020:01000000:3.0:1747400973.094350:0:13040:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400973.094352:0:13040:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747400973.094364:0:13040:0:(lov_pool.c:313:lov_pool_new()) testpool is pool #1 00000100:00100000:3.0:1747400973.094377:0:13040:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13040:1832281085809792:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400973.094402:0:13040:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05780 going to sleep for 6 seconds 00000100:00100000:3.0:1747400973.095178:0:13040:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13040:1832281085809792:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400973.095193:0:13040:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400973.095196:0:13040:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400973.095197:0:13040:0:(obd_config.c:1460:class_process_config()) marker 341 (0x2) lustre-clilov new lustre.testpool 00000040:00080000:3.0:1747400973.095199:0:13040:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 525 count 513 00000020:01000000:2.0:1747400973.095236:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 521-524 (rc=0) 10000000:01000000:2.0:1747400973.095261:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400973.095265:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400973.095276:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400973.095282:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400973.095284:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400973.095286:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400973.095297:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400973.095302:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400973.095307:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400973.095337:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809856:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400973.095356:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ef00 going to sleep for 6 seconds 00000100:00100000:2.0:1747400973.095981:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809856:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400973.095989:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400973.095995:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400973.096017:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809920:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400973.096042:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ef00 going to sleep for 6 seconds 00000100:00100000:2.0:1747400973.096714:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085809920:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400973.096733:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400973.096735:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400973.096740:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400973.121466:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400974.123385:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747400974.364887:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400974.364948:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400974.364988:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090212992 00000100:00100000:1.0:1747400974.364999:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090213056 00000100:00100000:0.0:1747400974.365029:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 270 00000100:00100000:0.0:1747400974.365035:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:30950:x1832281090212992:12345-192.168.204.160@tcp:104: 00000100:00100000:1.0:1747400974.365036:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 271 00000100:00100000:1.0:1747400974.365041:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:30950:x1832281090213056:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747400974.365050:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400974.365053:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400974.365125:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747400974.365130:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:30950:x1832281090212992:12345-192.168.204.160@tcp:104: Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1747400974.365137:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 270 00010000:00010000:1.0:1747400974.365149:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747400974.365154:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:30950:x1832281090213056:12345-192.168.204.160@tcp:104: Request processed in 113us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400974.365160:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 271 00010000:00010000:2.0:1747400974.365170:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747400974.365175:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400974.365183:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d6ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400974.365185:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400974.365189:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747400974.365192:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400974.365193:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400974.365197:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400974.365200:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d6880 already unused, calling callback (ffffffffa05055c0) 10000000:01000000:2.0:1747400974.365202:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1747400974.365203:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400974.365208:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747400974.365214:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747400974.365245:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747400974.365249:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400974.365254:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747400974.365271:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400974.365276:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf159b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bba14 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400974.365278:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400974.365283:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400974.365299:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400974.365303:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d6880/0xd95e55596abf1594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bba0d expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400974.365352:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400974.365353:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400974.365355:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400974.365359:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400974.365360:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400974.365361:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747400974.365367:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085809984:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747400974.365375:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085810048:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747400974.366130:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79ca140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085810048:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747400974.366174:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085809984:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747400975.125496:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747400975.355508:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400975.355514:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747400975.355516:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400975.355518:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747400975.355534:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085810112:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400975.355538:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085810176:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400975.356835:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085810112:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400975.356861:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085810176:192.168.204.160@tcp:400:kworker/u8:0.0 10000000:01000000:0.0:1747400975.792408:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747400975.792413:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 525 10000000:01000000:0.0:1747400975.792419:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747400975.792452:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400975.792459:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400975.792480:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400975.792498:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810240:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747400975.792561:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012a528300 going to sleep for 6 seconds 00000100:00100000:2.0:1747400975.793913:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810240:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400975.793926:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400975.793933:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400975.794010:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810304:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400975.794045:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e480 going to sleep for 6 seconds 00000100:00100000:2.0:1747400975.794657:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810304:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400975.794679:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810368:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747400975.794717:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e480 going to sleep for 6 seconds 00000100:00100000:2.0:1747400975.795631:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810368:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400975.795859:0:13102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cb900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13102:1832281085810432:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400975.795895:0:13102:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05240 going to sleep for 6 seconds 00000100:00100000:3.0:1747400975.796998:0:13102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cb900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13102:1832281085810432:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400975.797018:0:13102:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400975.797024:0:13102:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400975.797025:0:13102:0:(obd_config.c:1460:class_process_config()) marker 343 (0x1) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000020:01000000:3.0:1747400975.797029:0:13102:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400975.797031:0:13102:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747400975.797039:0:13102:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool as member 1 00000100:00100000:3.0:1747400975.797052:0:13102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cb900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13102:1832281085810496:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400975.797216:0:13102:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05240 going to sleep for 6 seconds 00000100:00100000:3.0:1747400975.798075:0:13102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cb900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13102:1832281085810496:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400975.798092:0:13102:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400975.798093:0:13102:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400975.798094:0:13102:0:(obd_config.c:1460:class_process_config()) marker 343 (0x2) lustre-clilov add lustre.testpool.lustre-OST0000_UUID 00000040:00080000:3.0:1747400975.798096:0:13102:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 528 count 516 00000020:01000000:2.0:1747400975.798149:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 525-527 (rc=0) 10000000:01000000:2.0:1747400975.798165:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400975.798170:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400975.798179:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400975.798186:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400975.798188:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400975.798203:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400975.798217:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400975.798222:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400975.798227:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400975.798237:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810560:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400975.798264:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e480 going to sleep for 6 seconds 00000100:00100000:2.0:1747400975.798839:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810560:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400975.798847:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400975.798856:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400975.798880:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810624:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400975.798909:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e480 going to sleep for 6 seconds 00000100:00100000:2.0:1747400975.799618:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810624:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400975.799633:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400975.799636:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400975.799641:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400976.127479:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747400976.849638:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400976.849696:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400976.849723:0:4656:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747400976.849750:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090215296 00000100:00100000:3.0:1747400976.849769:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090215360 00000100:00100000:1.0:1747400976.849794:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 272 00000100:00100000:1.0:1747400976.849800:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b6e31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:31091:x1832281090215296:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400976.849815:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400976.849821:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 25 00000100:00100000:3.0:1747400976.849825:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+4:31091:x1832281090215360:12345-192.168.204.160@tcp:104: 00010000:00010000:3.0:1747400976.849837:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400976.849888:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747400976.849892:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b6e31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:31091:x1832281090215296:12345-192.168.204.160@tcp:104: Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400976.849897:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 272 00010000:00010000:3.0:1747400976.849903:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1747400976.849907:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+3:31091:x1832281090215360:12345-192.168.204.160@tcp:104: Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1747400976.849912:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 25 00010000:00010000:2.0:1747400976.849916:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747400976.849920:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400976.849925:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d6ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400976.849927:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400976.849932:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400976.849936:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400976.849938:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1747400976.849939:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747400976.849941:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400976.849947:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f3180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747400976.849948:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400976.849952:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747400976.849956:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747400976.849960:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747400976.849973:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400976.849976:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400976.849977:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400976.849981:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400976.849988:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400976.849991:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400976.849993:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f3180/0xd95e55596abf15a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbae6 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400976.849994:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbaed expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400976.850005:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400976.850006:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400976.850006:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400976.850007:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400976.850008:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400976.850009:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747400976.850017:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085810688:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747400976.850017:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085810752:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747400976.850532:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085810688:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747400976.850560:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085810752:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747400977.129461:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747400977.502393:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747400977.502399:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 528 10000000:01000000:0.0:1747400977.502404:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747400977.502435:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400977.502442:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400977.502449:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400977.502468:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747400977.502526:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012a528d80 going to sleep for 6 seconds 00000100:00100000:2.0:1747400977.503685:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810816:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400977.503704:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400977.503712:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400977.503779:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400977.503834:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e540 going to sleep for 6 seconds 00000100:00100000:2.0:1747400977.504559:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810880:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400977.504583:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810944:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747400977.504629:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e540 going to sleep for 6 seconds 00000100:00100000:2.0:1747400977.505606:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085810944:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400977.505823:0:13122:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13122:1832281085811008:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400977.505864:0:13122:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05240 going to sleep for 6 seconds 00000100:00100000:3.0:1747400977.506921:0:13122:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13122:1832281085811008:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400977.506947:0:13122:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400977.506952:0:13122:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400977.506954:0:13122:0:(obd_config.c:1460:class_process_config()) marker 345 (0x1) lustre-clilov new lustre.testpool2 00000020:01000000:3.0:1747400977.506958:0:13122:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400977.506960:0:13122:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747400977.506974:0:13122:0:(lov_pool.c:313:lov_pool_new()) testpool2 is pool #2 00000100:00100000:3.0:1747400977.506987:0:13122:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13122:1832281085811072:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400977.507030:0:13122:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05540 going to sleep for 6 seconds 00000100:00100000:3.0:1747400977.507738:0:13122:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13122:1832281085811072:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400977.507762:0:13122:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400977.507764:0:13122:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400977.507764:0:13122:0:(obd_config.c:1460:class_process_config()) marker 345 (0x2) lustre-clilov new lustre.testpool2 00000040:00080000:3.0:1747400977.507766:0:13122:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 531 count 519 00000020:01000000:2.0:1747400977.507831:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 528-530 (rc=0) 10000000:01000000:2.0:1747400977.507848:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400977.507853:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400977.507861:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400977.507868:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400977.507870:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400977.507871:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400977.507885:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400977.507889:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400977.507895:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400977.507904:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811136:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400977.507930:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e540 going to sleep for 6 seconds 00000100:00100000:2.0:1747400977.508543:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811136:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400977.508552:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400977.508557:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400977.508583:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811200:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400977.508604:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e540 going to sleep for 6 seconds 00000100:00100000:2.0:1747400977.509193:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811200:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400977.509204:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400977.509206:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400977.509210:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400978.131452:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400979.133359:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747400979.362969:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400979.363022:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400979.363051:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090218880 00000100:00100000:0.0:1747400979.363051:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090218944 00000100:00100000:1.0:1747400979.363090:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 273 00000100:00100000:0.0:1747400979.363095:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 274 00000100:00100000:1.0:1747400979.363096:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:31277:x1832281090218880:12345-192.168.204.160@tcp:104: 00000100:00100000:0.0:1747400979.363099:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:31277:x1832281090218944:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400979.363110:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400979.363110:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400979.363199:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747400979.363204:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:31277:x1832281090218880:12345-192.168.204.160@tcp:104: Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400979.363209:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 273 00010000:00010000:0.0:1747400979.363221:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747400979.363225:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:31277:x1832281090218944:12345-192.168.204.160@tcp:104: Request processed in 126us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1747400979.363230:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 274 00010000:00010000:2.0:1747400979.363261:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747400979.363264:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747400979.363267:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400979.363272:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400979.363275:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d6ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400979.363277:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400979.363279:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747400979.363281:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400979.363285:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400979.363287:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747400979.363290:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400979.363290:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747400979.363293:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1747400979.363295:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747400979.363368:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400979.363375:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400979.363378:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747400979.363383:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400979.363390:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400979.363393:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2f40/0xd95e55596abf15b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbafb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400979.363393:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400979.363397:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d6ac0/0xd95e55596abf15b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbb02 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400979.363413:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400979.363414:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400979.363417:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400979.363418:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400979.363420:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400979.363425:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747400979.363436:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085811264:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747400979.363440:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085811328:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747400979.364686:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085811264:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747400979.364814:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085811328:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747400980.135477:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747400980.363464:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400980.363469:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747400980.363470:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400980.363472:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747400980.363491:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085811392:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400980.363491:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085811456:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400980.364544:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085811392:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400980.364571:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085811456:192.168.204.160@tcp:400:kworker/u8:0.0 10000000:01000000:2.0:1747400981.051454:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747400981.051458:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 531 10000000:01000000:2.0:1747400981.051461:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747400981.051492:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.051511:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.051519:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400981.051537:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811520:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400981.051596:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e840 going to sleep for 6 seconds 00000100:00100000:2.0:1747400981.052680:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811520:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400981.052693:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.052700:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400981.052740:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811584:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400981.052773:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e840 going to sleep for 6 seconds 00000100:00100000:2.0:1747400981.053634:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811584:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400981.053656:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811648:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747400981.053694:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e840 going to sleep for 6 seconds 00000100:00100000:2.0:1747400981.054375:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811648:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400981.054680:0:13185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13185:1832281085811712:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400981.054718:0:13185:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05900 going to sleep for 6 seconds 00000100:00100000:3.0:1747400981.055814:0:13185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13185:1832281085811712:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400981.055832:0:13185:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400981.055837:0:13185:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400981.055838:0:13185:0:(obd_config.c:1460:class_process_config()) marker 347 (0x1) lustre-clilov add lustre.testpool2.lustre-OST0000_UUID 00000020:01000000:3.0:1747400981.055842:0:13185:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400981.055844:0:13185:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747400981.055853:0:13185:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool2 as member 1 00000100:00100000:3.0:1747400981.055864:0:13185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13185:1832281085811776:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400981.055896:0:13185:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05900 going to sleep for 6 seconds 00000100:00100000:3.0:1747400981.056936:0:13185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13185:1832281085811776:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400981.056953:0:13185:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400981.056956:0:13185:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400981.056957:0:13185:0:(obd_config.c:1460:class_process_config()) marker 347 (0x2) lustre-clilov add lustre.testpool2.lustre-OST0000_UUID 00000040:00080000:3.0:1747400981.056959:0:13185:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 534 count 522 00000020:01000000:2.0:1747400981.057006:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 531-533 (rc=0) 10000000:01000000:2.0:1747400981.057021:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400981.057025:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.057036:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400981.057043:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400981.057045:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400981.057046:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400981.057058:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.057063:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.057068:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400981.057077:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811840:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400981.057120:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e840 going to sleep for 6 seconds 00000100:00100000:2.0:1747400981.057817:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811840:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400981.057826:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.057833:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400981.057858:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811904:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400981.057883:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e840 going to sleep for 6 seconds 00000100:00100000:2.0:1747400981.058687:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085811904:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400981.058703:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400981.058705:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.058709:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.137454:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747400981.851564:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400981.851595:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400981.851624:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090221312 00000100:00100000:1.0:1747400981.851660:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090221376 00000100:00100000:1.0:1747400981.851671:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 275 00000100:00100000:1.0:1747400981.851677:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9af17c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:31461:x1832281090221312:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400981.851693:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400981.851768:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747400981.851772:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9af17c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:31461:x1832281090221312:12345-192.168.204.160@tcp:104: Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400981.851790:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 275 00010000:00010000:3.0:1747400981.851804:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1747400981.851804:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 276 00000100:00100000:1.0:1747400981.851807:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9af4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:31461:x1832281090221376:12345-192.168.204.160@tcp:104: 00010000:00010000:3.0:1747400981.851809:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400981.851812:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400981.851820:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d6f40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747400981.851823:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400981.851829:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747400981.851834:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747400981.851837:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747400981.851847:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747400981.851850:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9af4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:31461:x1832281090221376:12345-192.168.204.160@tcp:104: Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400981.851854:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 276 00010000:00010000:3.0:1747400981.851872:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400981.851877:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747400981.851882:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747400981.851886:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.851891:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d6d00 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:3.0:1747400981.851893:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400981.851893:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400981.851898:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d6f40/0xd95e55596abf15c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbbdb expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.851898:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400981.851902:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400981.851906:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747400981.851910:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400981.851911:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400981.851912:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400981.851919:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.851923:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1747400981.851926:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085811968:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747400981.851927:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.851931:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d6d00/0xd95e55596abf15be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbbd4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400981.851952:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400981.851953:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400981.851954:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747400981.851963:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085812032:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747400981.852839:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085811968:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747400981.852856:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085812032:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747400982.139509:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400983.141448:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747400983.664440:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747400983.664446:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 534 10000000:01000000:1.0:1747400983.664451:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747400983.664497:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400983.664505:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400983.664514:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400983.664535:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af0e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812096:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747400983.664621:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34180 going to sleep for 6 seconds 00000100:00100000:0.0:1747400983.665491:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af0e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812096:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1747400983.665511:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400983.665519:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400983.665573:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812160:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1747400983.665613:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012a528540 going to sleep for 6 seconds 00000100:00100000:2.0:1747400983.666265:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812160:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400983.666292:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812224:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747400983.666356:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 6 seconds 00000100:00100000:2.0:1747400983.667139:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812224:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400983.667369:0:13298:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13298:1832281085812288:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400983.667417:0:13298:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc056c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747400983.668471:0:13298:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13298:1832281085812288:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400983.668497:0:13298:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400983.668504:0:13298:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400983.668505:0:13298:0:(obd_config.c:1460:class_process_config()) marker 349 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747400983.668509:0:13298:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400983.668511:0:13298:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747400983.668523:0:13298:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747400983.668537:0:13298:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13298:1832281085812352:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400983.668576:0:13298:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc056c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747400983.669597:0:13298:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13298:1832281085812352:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400983.669626:0:13298:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400983.669631:0:13298:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400983.669632:0:13298:0:(obd_config.c:1460:class_process_config()) marker 349 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747400983.669635:0:13298:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 537 count 525 00000020:01000000:2.0:1747400983.669705:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 534-536 (rc=0) 10000000:01000000:2.0:1747400983.669727:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400983.669735:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400983.669744:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400983.669753:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400983.669756:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400983.669758:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400983.669781:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400983.669786:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400983.669801:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400983.669814:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812416:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400983.669858:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 6 seconds 00000100:00100000:2.0:1747400983.670499:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812416:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400983.670516:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400983.670524:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400983.670564:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812480:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400983.670598:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 6 seconds 00000100:00100000:2.0:1747400983.671274:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812480:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400983.671289:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400983.671292:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400983.671297:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400984.101353:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400984.101421:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090224128 00000100:00100000:0.0:1747400984.101465:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 277 00000100:00100000:0.0:1747400984.101471:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9af0980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+3:32129:x1832281090224128:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747400984.101488:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400984.101499:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400984.101547:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090224192 00010000:00010000:0.0:1747400984.101569:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747400984.101574:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 278 00000100:00100000:0.0:1747400984.101574:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9af0980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:32129:x1832281090224128:12345-192.168.204.160@tcp:104: Request processed in 103us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400984.101586:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9af04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:32129:x1832281090224192:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400984.101597:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400984.101627:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747400984.101633:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400984.101640:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d7180 already unused, calling callback (ffffffffa05055c0) 00000100:00100000:0.0:1747400984.101640:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 277 10000000:00010000:2.0:1747400984.101652:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400984.101655:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1747400984.101658:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400984.101659:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9af04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:32129:x1832281090224192:12345-192.168.204.160@tcp:104: Request processed in 74us (167us total) trans 0 rc 0/0 10000000:00010000:2.0:1747400984.101664:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400984.101664:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 278 10000000:01000000:2.0:1747400984.101668:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747400984.101697:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747400984.101702:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400984.101703:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400984.101708:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400984.101710:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45aac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747400984.101713:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400984.101719:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747400984.101723:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400984.101726:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400984.101730:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbc52 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747400984.101736:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747400984.101754:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400984.101756:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400984.101757:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400984.101763:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400984.101765:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1747400984.101768:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400984.101777:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400984.101781:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085812544:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747400984.101782:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abf15cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbc4b expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400984.101797:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400984.101798:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400984.101799:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747400984.101805:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747400984.101817:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085812608:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747400984.103714:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085812608:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747400984.103760:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085812544:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747400984.143421:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400985.145573:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747400985.371458:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400985.371462:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747400985.371463:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400985.371475:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747400985.371501:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085812736:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400985.371514:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085812672:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400985.372695:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085812672:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400985.372697:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085812736:192.168.204.160@tcp:400:kworker/u8:0.0 10000000:01000000:0.0:1747400985.666442:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747400985.666450:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 537 10000000:01000000:0.0:1747400985.666455:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747400985.666515:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400985.666524:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400985.666534:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400985.666558:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812800:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747400985.666650:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012a528900 going to sleep for 6 seconds 00000100:00100000:2.0:1747400985.667966:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812800:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400985.667983:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400985.667990:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400985.668077:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812864:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400985.668128:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 6 seconds 00000100:00100000:2.0:1747400985.668848:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812864:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400985.668865:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812928:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747400985.668902:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 6 seconds 00000100:00100000:2.0:1747400985.669764:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085812928:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400985.670075:0:13319:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13319:1832281085812992:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400985.670123:0:13319:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc050c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747400985.671234:0:13319:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13319:1832281085812992:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400985.671257:0:13319:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400985.671264:0:13319:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400985.671270:0:13319:0:(obd_config.c:1460:class_process_config()) marker 351 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747400985.671275:0:13319:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400985.671277:0:13319:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747400985.671285:0:13319:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000020:01000000:3.0:1747400985.671287:0:13319:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400985.671289:0:13319:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400985.671290:0:13319:0:(obd_config.c:1460:class_process_config()) marker 351 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747400985.671291:0:13319:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400985.671293:0:13319:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400985.671293:0:13319:0:(obd_config.c:1460:class_process_config()) marker 353 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747400985.671295:0:13319:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400985.671297:0:13319:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747400985.671299:0:13319:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747400985.671338:0:13319:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13319:1832281085813056:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400985.671372:0:13319:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc050c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747400985.672328:0:13319:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13319:1832281085813056:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400985.672345:0:13319:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400985.672348:0:13319:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400985.672349:0:13319:0:(obd_config.c:1460:class_process_config()) marker 353 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747400985.672352:0:13319:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 543 count 531 00000020:01000000:2.0:1747400985.672430:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 537-542 (rc=0) 10000000:01000000:2.0:1747400985.672446:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400985.672451:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400985.672458:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400985.672472:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400985.672474:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400985.672476:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400985.672490:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400985.672494:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400985.672499:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400985.672506:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085813120:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400985.672538:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 6 seconds 00000100:00100000:2.0:1747400985.673191:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085813120:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400985.673201:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400985.673207:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400985.673235:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085813184:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400985.673263:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 6 seconds 00000100:00100000:2.0:1747400985.673887:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085813184:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400985.673901:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400985.673903:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400985.673913:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.147581:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1747400986.634446:0:13321:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400986.634461:0:13321:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400986.634472:0:13321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400986.634483:0:13321:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400986.634492:0:13321:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400986.634498:0:13321:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400986.634504:0:13321:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800ae89be00 00010000:00010000:3.0:1747400986.634506:0:13321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400986.634512:0:13321:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400986.634524:0:13321:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 101 00000080:00200000:3.0:1747400986.634532:0:13321:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400986.634536:0:13321:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400986.634540:0:13321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400986.634545:0:13321:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400986.634550:0:13321:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400986.634551:0:13321:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400986.634553:0:13321:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800ae89bb58 00010000:00010000:3.0:1747400986.634554:0:13321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400986.634559:0:13321:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400986.634565:0:13321:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747400986.634571:0:13321:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=1536 00000080:00200000:3.0:1747400986.634573:0:13321:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400986.634581:0:13321:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400986.634585:0:13321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400986.634590:0:13321:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400986.634594:0:13321:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400986.634596:0:13321:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400986.634598:0:13321:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800ae89bbf0 00010000:00010000:3.0:1747400986.634599:0:13321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400986.634603:0:13321:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400986.634609:0:13321:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747400986.634613:0:13321:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400986.634615:0:13321:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400986.634618:0:13321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400986.634622:0:13321:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400986.634627:0:13321:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400986.634628:0:13321:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400986.634630:0:13321:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800ae89bda0 00010000:00010000:3.0:1747400986.634631:0:13321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400986.634640:0:13321:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400986.634645:0:13321:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747400986.634649:0:13321:0:(namei.c:1935:ll_mkdir()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8) 00000020:00100000:3.0:1747400986.634689:0:13321:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747400986.634696:0:13321:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a79cbdc0 x1832281085813312/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747400986.634712:0:13321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13321:1832281085813312:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:3.0:1747400986.634777:0:13321:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc050c0 going to sleep for 30 seconds 00000100:00100000:3.0:1747400986.637273:0:13321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cbdc0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13321:1832281085813312:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:3.0:1747400986.637297:0:13321:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618) 00000080:00200000:3.0:1747400986.637300:0:13321:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x28fc:0x0], updating i_size 512 00000080:00200000:2.0:1747400986.641482:0:13322:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747400986.641497:0:13322:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747400986.641508:0:13322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.641518:0:13322:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747400986.641526:0:13322:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747400986.641528:0:13322:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747400986.641533:0:13322:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a999bbb0 00010000:00010000:2.0:1747400986.641535:0:13322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.641540:0:13322:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747400986.641551:0:13322:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747400986.641557:0:13322:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747400986.641560:0:13322:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747400986.641563:0:13322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.641567:0:13322:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747400986.641576:0:13322:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747400986.641577:0:13322:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747400986.641579:0:13322:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a999bba0 00010000:00010000:2.0:1747400986.641580:0:13322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.641584:0:13322:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747400986.641589:0:13322:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:2.0:1747400986.641592:0:13322:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), file ffff8800ae8c8c00, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1747400986.641597:0:13322:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=open|creat 00000002:00010000:2.0:1747400986.641606:0:13322:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x200000401:0x28fd:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1747400986.641643:0:13322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.641648:0:13322:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747400986.641657:0:13322:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747400986.641664:0:13322:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012d46df00 x1832281085813440/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747400986.641670:0:13322:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400986.641685:0:13322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13322:1832281085813440:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747400986.641786:0:13322:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 30 seconds 00000100:00100000:2.0:1747400986.643359:0:13322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13322:1832281085813440:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747400986.643370:0:13322:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643378:0:13322:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643382:0:13322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643386:0:13322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643391:0:13322:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643395:0:13322:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d73c0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747400986.643397:0:13322:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643401:0:13322:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643405:0:13322:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643409:0:13322:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747400986.643413:0:13322:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643428:0:13322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d73c0/0xd95e55596abf15e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747400986.643439:0:13322:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff88012d46df00 x1832281085813440/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747401017 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747400986.643500:0:13322:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747400986.643506:0:13322:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747400986.643512:0:13322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643518:0:13322:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747400986.643524:0:13322:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747400986.643525:0:13322:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747400986.643528:0:13322:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a999bbb0 00010000:00010000:2.0:1747400986.643529:0:13322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643534:0:13322:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747400986.643541:0:13322:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747400986.643547:0:13322:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), file ffff8800b6f38c00, open_flags 1a100, mode 0 opened 0 00000080:00200000:2.0:1747400986.643551:0:13322:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=open 00000002:00010000:2.0:1747400986.643555:0:13322:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0320401 00010000:00010000:2.0:1747400986.643573:0:13322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.643581:0:13322:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747400986.643588:0:13322:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747400986.643592:0:13322:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012d46df00 x1832281085813568/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747400986.643597:0:13322:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400986.643606:0:13322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13322:1832281085813568:192.168.204.160@tcp:101:lfs.0 00000100:00100000:2.0:1747400986.643658:0:13322:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 30 seconds 00000100:00100000:2.0:1747400986.644535:0:13322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13322:1832281085813568:192.168.204.160@tcp:101:lfs.0 00010000:00010000:2.0:1747400986.644542:0:13322:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644549:0:13322:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644553:0:13322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644557:0:13322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644560:0:13322:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644571:0:13322:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d7600 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747400986.644573:0:13322:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644577:0:13322:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644580:0:13322:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644584:0:13322:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747400986.644586:0:13322:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400986.644589:0:13322:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7600/0xd95e55596abf15ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13322 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747400986.644597:0:13322:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012d46df00 x1832281085813568/t4294998779(4294998779) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:2.0:1747400986.644604:0:13322:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012d46df00 x1832281085813568/t4294998779(4294998779) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747400986.644619:0:13322:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x28fc:0x0], updating i_size 512 00000080:00200000:2.0:1747400986.644621:0:13322:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x28fc:0x0](ffff8800af31d618): rc = 0 00000080:00010000:2.0:1747400986.644625:0:13322:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x28fc:0x0](ffff8800af31d618) for lock 0x0 00000080:00200000:2.0:1747400986.644634:0:13322:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), flags 320400 00000002:00100000:2.0:1747400986.644642:0:13322:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012d46df00 x1832281085813568/t4294998779(4294998779) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:2.0:1747400986.644676:0:13322:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), inode mode 41ed mask 44 00000080:00200000:2.0:1747400986.644698:0:13322:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), cmd=0x4008669a 00000020:00100000:2.0:1747400986.644716:0:13322:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1747400986.644719:0:13322:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012d46d580 x1832281085813696/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747400986.644727:0:13322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13322:1832281085813696:192.168.204.160@tcp:36:lfs.0 00000100:00100000:2.0:1747400986.644760:0:13322:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 30 seconds 00000100:00100000:2.0:1747400986.645823:0:13322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13322:1832281085813696:192.168.204.160@tcp:36:lfs.0 00000080:00200000:2.0:1747400986.645845:0:13322:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618) 00000002:00100000:2.0:1747400986.645867:0:13322:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012d46df00 x1832281085813568/t4294998779(4294998779) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747401017 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:2.0:1747400986.645878:0:13322:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747400986.645881:0:13322:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012d46d0c0 x1832281085813824/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747400986.645890:0:13322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46d0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13322:1832281085813824:192.168.204.160@tcp:35:lfs.0 00000100:00100000:2.0:1747400986.645918:0:13322:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995ea80 going to sleep for 43 seconds 00000100:00100000:2.0:1747400986.646899:0:13322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46d0c0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13322:1832281085813824:192.168.204.160@tcp:35:lfs.0 00000002:00100000:2.0:1747400986.646913:0:13322:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012d46df00 x1832281085813568/t4294998779(4294998779) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 528/600 e 0 to 0 dl 1747401017 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1747400986.650912:0:13323:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747400986.650927:0:13323:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747400986.650938:0:13323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.650948:0:13323:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747400986.650956:0:13323:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747400986.650958:0:13323:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747400986.650963:0:13323:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800ab4afbb0 00010000:00010000:1.0:1747400986.650965:0:13323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.650970:0:13323:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747400986.650980:0:13323:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747400986.650985:0:13323:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), file ffff8800b3ad3080, open_flags 18800, mode 0 opened 0 00000080:00200000:1.0:1747400986.651001:0:13323:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=open 00000002:00010000:1.0:1747400986.651010:0:13323:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0304001 00010000:00010000:1.0:1747400986.651041:0:13323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.651046:0:13323:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747400986.651055:0:13323:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747400986.651063:0:13323:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af0000 x1832281085813952/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747400986.651069:0:13323:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400986.651083:0:13323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af0000 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085813952:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747400986.651178:0:13323:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34300 going to sleep for 30 seconds 00000100:00100000:1.0:1747400986.652902:0:13323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af0000 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085813952:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747400986.652913:0:13323:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652924:0:13323:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652929:0:13323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652933:0:13323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652938:0:13323:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652948:0:13323:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45aac0 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747400986.652950:0:13323:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652954:0:13323:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652958:0:13323:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652963:0:13323:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747400986.652965:0:13323:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.652968:0:13323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45aac0/0xd95e55596abf15f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747400986.652978:0:13323:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a9af0000 x1832281085813952/t4294998782(4294998782) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747400986.652985:0:13323:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af0000 x1832281085813952/t4294998782(4294998782) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747400986.653014:0:13323:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x28fc:0x0], updating i_size 512 00000080:00200000:1.0:1747400986.653015:0:13323:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x28fc:0x0](ffff8800af31d618): rc = 0 00000080:00010000:1.0:1747400986.653019:0:13323:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x28fc:0x0](ffff8800af31d618) for lock 0x0 00000080:00200000:1.0:1747400986.653028:0:13323:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), flags 304000 00000002:00100000:1.0:1747400986.653037:0:13323:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af0000 x1832281085813952/t4294998782(4294998782) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747400986.653077:0:13323:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), inode mode 41ed mask 44 00000080:00200000:1.0:1747400986.653091:0:13323:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747400986.653096:0:13323:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747400986.653101:0:13323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.653107:0:13323:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747400986.653112:0:13323:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747400986.653113:0:13323:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747400986.653115:0:13323:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800ab4afbb0 00010000:00010000:1.0:1747400986.653116:0:13323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.653121:0:13323:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747400986.653128:0:13323:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747400986.653134:0:13323:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), file ffff8800b3ad2000, open_flags 28800, mode 0 opened 0 00000080:00200000:1.0:1747400986.653137:0:13323:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=open 00000002:00010000:1.0:1747400986.653141:0:13323:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0504001 00010000:00010000:1.0:1747400986.653157:0:13323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.653162:0:13323:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747400986.653176:0:13323:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747400986.653180:0:13323:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af5a40 x1832281085814080/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747400986.653184:0:13323:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400986.653193:0:13323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085814080:192.168.204.160@tcp:101:lfs.0 00000100:00100000:1.0:1747400986.653239:0:13323:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34300 going to sleep for 30 seconds 00000100:00100000:1.0:1747400986.654393:0:13323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085814080:192.168.204.160@tcp:101:lfs.0 00010000:00010000:1.0:1747400986.654401:0:13323:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654407:0:13323:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654411:0:13323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654415:0:13323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654419:0:13323:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654422:0:13323:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b180 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:1.0:1747400986.654423:0:13323:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654435:0:13323:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654439:0:13323:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654443:0:13323:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1747400986.654446:0:13323:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.654449:0:13323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45b180/0xd95e55596abf15fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13323 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747400986.654464:0:13323:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a9af5a40 x1832281085814080/t4294998783(4294998783) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747400986.654471:0:13323:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af5a40 x1832281085814080/t4294998783(4294998783) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747400986.654484:0:13323:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x28fc:0x0], updating i_size 512 00000080:00200000:1.0:1747400986.654485:0:13323:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x28fc:0x0](ffff8800af31d618): rc = 0 00000080:00010000:1.0:1747400986.654487:0:13323:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x28fc:0x0](ffff8800af31d618) for lock 0x0 00000080:00200000:1.0:1747400986.654500:0:13323:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), flags 504000 00000002:00100000:1.0:1747400986.654508:0:13323:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af5a40 x1832281085814080/t4294998783(4294998783) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1747400986.654519:0:13323:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af5a40 x1832281085814080/t4294998783(4294998783) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:1.0:1747400986.654531:0:13323:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747400986.654534:0:13323:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af7200 x1832281085814208/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747400986.654548:0:13323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af7200 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085814208:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747400986.654582:0:13323:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34300 going to sleep for 43 seconds 00000100:00100000:1.0:1747400986.655694:0:13323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af7200 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085814208:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747400986.655705:0:13323:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af5a40 x1832281085814080/t4294998783(4294998783) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1747400986.655752:0:13323:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), inode mode 41ed mask 44 00000080:00200000:1.0:1747400986.655769:0:13323:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618) 00000080:00200000:1.0:1747400986.655808:0:13323:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), cmd=0x4008669b 00000100:00100000:1.0:1747400986.655832:0:13323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085814272:192.168.204.160@tcp:33:lfs.0 00000100:00100000:1.0:1747400986.655861:0:13323:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34300 going to sleep for 30 seconds 00000100:00100000:1.0:1747400986.657504:0:13323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085814272:192.168.204.160@tcp:33:lfs.0 00000080:00200000:1.0:1747400986.657623:0:13323:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618) 00000002:00100000:1.0:1747400986.657644:0:13323:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af0000 x1832281085813952/t4294998782(4294998782) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:1.0:1747400986.657656:0:13323:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747400986.657659:0:13323:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af5a40 x1832281085814400/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747400986.657669:0:13323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085814400:192.168.204.160@tcp:35:lfs.0 00000100:00100000:1.0:1747400986.657695:0:13323:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34300 going to sleep for 43 seconds 00000100:00100000:1.0:1747400986.658813:0:13323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13323:1832281085814400:192.168.204.160@tcp:35:lfs.0 00000002:00100000:1.0:1747400986.658824:0:13323:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af0000 x1832281085813952/t4294998782(4294998782) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401017 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:1.0:1747400986.661383:0:13324:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:1.0:1747400986.661398:0:13324:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747400986.661407:0:13324:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.661414:0:13324:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1747400986.661419:0:13324:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:1.0:1747400986.661420:0:13324:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:1.0:1747400986.661423:0:13324:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a999bbb0 00010000:00010000:1.0:1747400986.661425:0:13324:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.661428:0:13324:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747400986.661436:0:13324:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:1.0:1747400986.661441:0:13324:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=17 00000080:00200000:1.0:1747400986.661443:0:13324:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=0 00000002:00010000:1.0:1747400986.661447:0:13324:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1747400986.661467:0:13324:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.661471:0:13324:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.661475:0:13324:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400986.661488:0:13324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13324:1832281085814464:192.168.204.160@tcp:101:createmany.0 00000100:00100000:1.0:1747400986.661542:0:13324:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34300 going to sleep for 30 seconds 00000100:00100000:1.0:1747400986.663178:0:13324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13324:1832281085814464:192.168.204.160@tcp:101:createmany.0 00010000:00010000:1.0:1747400986.663189:0:13324:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663199:0:13324:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663203:0:13324:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663209:0:13324:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663215:0:13324:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663221:0:13324:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663225:0:13324:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663229:0:13324:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747400986.663237:0:13324:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a9af5a40 x1832281085814464/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/640 e 0 to 0 dl 1747401017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'createmany.0' 00000002:00010000:1.0:1747400986.663253:0:13324:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663259:0:13324:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/10492 (0 0) 00000080:00200000:1.0:1747400986.663273:0:13324:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x28fc:0x0], updating i_size 512 00000080:00200000:1.0:1747400986.663275:0:13324:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x28fc:0x0](ffff8800af31d618): rc = 0 00000080:00010000:1.0:1747400986.663279:0:13324:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x28fc:0x0](ffff8800af31d618) for lock 0xd95e55596abf1604 00000080:00010000:1.0:1747400986.663285:0:13324:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x28fc:0x0](ffff8800af31d618) 00000080:00010000:1.0:1747400986.663287:0:13324:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abf1604 from it ffff8800a999bb20 00010000:00010000:1.0:1747400986.663287:0:13324:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663291:0:13324:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45a640/0xd95e55596abf1604 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x28fc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbdcc expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1747400986.663302:0:13324:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), inode mode 41ed mask 1 00000080:00200000:1.0:1747400986.663323:0:13324:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), inode mode 41ed mask 3 00000080:00200000:1.0:1747400986.663326:0:13324:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=f22.ost-pools0, dir=[0x200000401:0x28fc:0x0](ffff8800af31d618), file ffff8800ae997e00, open_flags 8042, mode 81a4 opened 0 00000080:00200000:1.0:1747400986.663330:0:13324:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22.ost-pools0, dir=[0x200000401:0x28fc:0x0](ffff8800af31d618), intent=open|creat 00000002:00010000:1.0:1747400986.663339:0:13324:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22.ost-pools0,[0x200000401:0x28fe:0x0]) in obj [0x200000401:0x28fc:0x0], intent: open|creat flags 0100103 00010000:00010000:1.0:1747400986.663356:0:13324:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400986.663359:0:13324:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1747400986.663364:0:13324:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1747400986.663369:0:13324:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af5a40 x1832281085814592/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1747400986.663374:0:13324:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400986.663384:0:13324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13324:1832281085814592:192.168.204.160@tcp:101:createmany.0 00000100:00100000:1.0:1747400986.663459:0:13324:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34300 going to sleep for 30 seconds 00010000:00010000:3.0:1747400987.149568:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747400987.579131:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400987.579174:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400987.579215:0:29517:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747400987.579236:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090230912 00000100:00100000:3.0:1747400987.579237:0:4658:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090231040 00000100:00100000:1.0:1747400987.579275:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 279 00000100:00100000:3.0:1747400987.579277:0:4658:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 26 00000100:00100000:1.0:1747400987.579279:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:32277:x1832281090230912:12345-192.168.204.160@tcp:104: 00000100:00100000:3.0:1747400987.579281:0:4658:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+4:32277:x1832281090231040:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400987.579289:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400987.579291:0:4658:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400987.579363:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1747400987.579366:0:4658:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747400987.579366:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:32277:x1832281090230912:12345-192.168.204.160@tcp:104: Request processed in 87us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1747400987.579369:0:4658:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7b80d169-0905-4300-a34c-b155594364e5+4:32277:x1832281090231040:12345-192.168.204.160@tcp:104: Request processed in 89us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400987.579370:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 279 00000100:00100000:3.0:1747400987.579374:0:4658:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 26 00010000:00010000:2.0:1747400987.579381:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747400987.579385:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400987.579390:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d7180 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:3.0:1747400987.579394:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1747400987.579400:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400987.579402:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400987.579404:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400987.579406:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747400987.579408:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400987.579408:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400987.579410:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747400987.579411:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747400987.579414:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747400987.579417:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747400987.579434:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400987.579436:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747400987.579438:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400987.579440:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747400987.579447:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400987.579449:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400987.579450:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf15e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbcd0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400987.579453:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abf15da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbcc9 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400987.579460:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400987.579461:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400987.579462:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400987.579473:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400987.579474:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400987.579475:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747400987.579476:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cd0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085814720:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747400987.579485:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085814656:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747400987.580227:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cd0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085814720:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747400987.580245:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085814656:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747400988.151509:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747400988.739416:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747400988.739421:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 543 10000000:01000000:0.0:1747400988.739425:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747400988.739458:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400988.739466:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400988.739473:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400988.739488:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085814784:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747400988.739545:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012a5286c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747400988.740823:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711e3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085814784:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400988.740847:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400988.740855:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400988.740935:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085814848:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400988.741022:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e180 going to sleep for 6 seconds 00000100:00100000:2.0:1747400988.741922:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085814848:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400988.741963:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085814912:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747400988.742008:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e180 going to sleep for 6 seconds 00000100:00100000:2.0:1747400988.742787:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085814912:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400988.743058:0:13335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13335:1832281085814976:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400988.743108:0:13335:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747400988.744191:0:13335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13335:1832281085814976:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400988.744214:0:13335:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400988.744222:0:13335:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400988.744224:0:13335:0:(obd_config.c:1460:class_process_config()) marker 355 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747400988.744229:0:13335:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400988.744232:0:13335:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747400988.744243:0:13335:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool 00000100:00100000:3.0:1747400988.744258:0:13335:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13335:1832281085815040:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400988.744300:0:13335:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747400988.745046:0:13335:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13335:1832281085815040:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400988.745068:0:13335:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400988.745072:0:13335:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400988.745073:0:13335:0:(obd_config.c:1460:class_process_config()) marker 355 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747400988.745076:0:13335:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 546 count 534 00000020:01000000:2.0:1747400988.745134:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 543-545 (rc=0) 10000000:01000000:2.0:1747400988.745155:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400988.745162:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400988.745169:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400988.745175:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400988.745177:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400988.745179:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400988.745194:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400988.745199:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400988.745206:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400988.745215:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085815104:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400988.745257:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e180 going to sleep for 6 seconds 00000100:00100000:2.0:1747400988.745890:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085815104:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400988.745899:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400988.745905:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400988.745930:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085815168:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400988.745962:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e180 going to sleep for 6 seconds 00000100:00100000:2.0:1747400988.746484:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085815168:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400988.746499:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400988.746502:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400988.746509:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400989.153473:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400990.155521:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747400990.379461:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400990.379465:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747400990.379466:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400990.379468:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747400990.379488:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085815296:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400990.379505:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085815232:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747400990.380786:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085815232:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747400990.380815:0:1865:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294998785 gen 1 00000100:00100000:2.0:1747400990.380838:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085815296:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:0.0:1747400991.157473:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400992.159484:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400993.161522:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400994.163484:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400995.165493:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747400995.387491:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400995.387496:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747400995.387498:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747400995.387500:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747400995.387519:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085815360:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747400995.387519:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085815424:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747400995.388882:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085815424:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747400995.388906:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085815360:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747400996.167505:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400997.169455:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400998.171479:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747400999.173734:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401000.175492:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747401000.395494:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401000.395499:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747401000.395500:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401000.395502:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747401000.395525:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085815552:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747401000.395601:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747401000.395606:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085815488:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747401000.396754:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085815488:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747401000.396776:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085815552:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747401001.177528:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401002.179494:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401003.181521:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401004.183536:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401005.185496:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747401005.403472:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401005.403479:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747401005.403481:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401005.403483:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747401005.403507:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085815616:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747401005.403507:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085815680:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747401005.404793:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085815680:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747401005.404820:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085815616:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747401006.187522:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747401006.665069:0:13324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5a40 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13324:1832281085814592:192.168.204.160@tcp:101:createmany.0 00010000:00010000:1.0:1747401006.665086:0:13324:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401006.665100:0:13324:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 4/0,1 mode: --/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401006.665104:0:13324:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 4/0,1 mode: --/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401006.665117:0:13324:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401006.665122:0:13324:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401006.665127:0:13324:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401006.665130:0:13324:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401006.665133:0:13324:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1747401006.665138:0:13324:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8800a9af5a40 x1832281085814592/t4294998786(4294998786) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/672 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'createmany.0' 00000002:00100000:1.0:1747401006.665145:0:13324:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af5a40 x1832281085814592/t4294998786(4294998786) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/672 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'createmany.0' 00000002:00010000:1.0:1747401006.665154:0:13324:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 72 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1747401006.665163:0:13324:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747401006.665170:0:13324:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 16 res 8589935617/10494 (0 0) 00000080:00200000:1.0:1747401006.665185:0:13324:0:(namei.c:1416:ll_create_it()) VFS Op:name=f22.ost-pools0, dir=[0x200000401:0x28fc:0x0](ffff8800af31d618), intent=open|creat 00000080:00200000:1.0:1747401006.665206:0:13324:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x28fe:0x0](ffff8800af236598) 00000080:00200000:1.0:1747401006.665258:0:13324:0:(file.c:5871:ll_layout_conf()) [0x200000401:0x28fe:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1747401006.665262:0:13324:0:(namei.c:1383:ll_create_node()) setting l_ast_data to inode [0x200000401:0x28fe:0x0](ffff8800af236598) 00000080:00010000:1.0:1747401006.665264:0:13324:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x28fe:0x0](ffff8800af236598) for lock 0xd95e55596abf160b 00000080:00200000:1.0:1747401006.665273:0:13324:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x28fe:0x0](ffff8800af236598), flags 100102 00000002:00100000:1.0:1747401006.665282:0:13324:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9af5a40 x1832281085814592/t4294998786(4294998786) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 600/672 e 0 to 0 dl 1747401017 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'createmany.0' 00000080:00010000:1.0:1747401006.665356:0:13324:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abf160b from it ffff8800a74e9900 00010000:00010000:1.0:1747401006.665358:0:13324:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1747401006.665363:0:13324:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b45ba80/0xd95e55596abf160b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x28fe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xb255fa25cf6bbe51 expref: -99 pid: 13324 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1747401006.665376:0:13324:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x28fe:0x0](ffff8800af236598), inode mode 81a4 mask 40 00000080:00200000:1.0:1747401006.665404:0:13324:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x28fe:0x0](ffff8800af236598) 00000002:00100000:1.0:1747401006.665421:0:13324:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9af5a40 x1832281085814592/t4294998786(4294998786) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 600/672 e 0 to 0 dl 1747401017 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'createmany.0' 00000020:00100000:1.0:1747401006.665437:0:13324:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1747401006.665440:0:13324:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9af17c0 x1832281085815808/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1747401006.665452:0:13324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13324:1832281085815808:192.168.204.160@tcp:35:createmany.0 00000100:00100000:1.0:1747401006.665490:0:13324:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34cc0 going to sleep for 43 seconds 00000100:00100000:2.0:1747401006.666760:0:13324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af17c0 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13324:1832281085815808:192.168.204.160@tcp:35:createmany.0 00000002:00100000:2.0:1747401006.666773:0:13324:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9af5a40 x1832281085814592/t4294998786(4294998786) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 600/672 e 0 to 0 dl 1747401017 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'createmany.0' 00000080:00200000:2.0:1747401006.666893:0:13324:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:2.0:1747401006.666903:0:13324:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1747401006.666910:0:13324:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.666917:0:13324:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1747401006.666923:0:13324:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:2.0:1747401006.666925:0:13324:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:2.0:1747401006.666928:0:13324:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff8800a999bbb0 00010000:00010000:2.0:1747401006.666934:0:13324:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.666939:0:13324:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1747401006.666946:0:13324:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:2.0:1747401006.666951:0:13324:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d22.ost-pools, flags=17 00000080:00200000:2.0:1747401006.666953:0:13324:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), inode mode 41ed mask 1 00000080:00200000:2.0:1747401006.666960:0:13324:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x28fc:0x0](ffff8800af31d618), inode mode 41ed mask 3 00000080:00200000:2.0:1747401006.666962:0:13324:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=f22.ost-pools1, dir=[0x200000401:0x28fc:0x0](ffff8800af31d618), file ffff8800b3f59380, open_flags 8042, mode 81a4 opened 0 00000080:00200000:2.0:1747401006.666968:0:13324:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22.ost-pools1, dir=[0x200000401:0x28fc:0x0](ffff8800af31d618), intent=open|creat 00000002:00010000:2.0:1747401006.666978:0:13324:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22.ost-pools1,[0x200000401:0x28ff:0x0]) in obj [0x200000401:0x28fc:0x0], intent: open|creat flags 0100103 00010000:00010000:2.0:1747401006.667004:0:13324:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.667008:0:13324:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1747401006.667014:0:13324:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1747401006.667017:0:13324:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012d46d580 x1832281085815936/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1747401006.667022:0:13324:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747401006.667032:0:13324:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13324:1832281085815936:192.168.204.160@tcp:101:createmany.0 00000100:00100000:2.0:1747401006.667111:0:13324:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e180 going to sleep for 30 seconds 00000100:00100000:0.0:1747401006.910928:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747401006.910981:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747401006.911016:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090234816 00000100:00100000:0.0:1747401006.911016:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090234752 00000100:00100000:0.0:1747401006.911055:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 280 00000100:00100000:1.0:1747401006.911062:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 281 00000100:00100000:0.0:1747401006.911062:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:32390:x1832281090234816:12345-192.168.204.160@tcp:104: 00000100:00100000:1.0:1747401006.911065:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:32390:x1832281090234752:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747401006.911075:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401006.911077:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747401006.911142:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747401006.911147:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:32390:x1832281090234816:12345-192.168.204.160@tcp:104: Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1747401006.911152:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 280 00010000:00010000:1.0:1747401006.911159:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747401006.911163:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:32390:x1832281090234752:12345-192.168.204.160@tcp:104: Request processed in 97us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1747401006.911168:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 281 00010000:00010000:3.0:1747401006.911184:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747401006.911189:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747401006.911196:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2880 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:2.0:1747401006.911196:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1747401006.911199:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747401006.911205:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.911208:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747401006.911210:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747401006.911214:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747401006.911215:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d7180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747401006.911217:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.911223:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747401006.911229:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747401006.911231:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747401006.911246:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747401006.911251:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747401006.911258:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.911260:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747401006.911266:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.911269:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747401006.911271:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abf1612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbe43 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.911272:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d7180/0xd95e55596abf1619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbe4a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401006.911291:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401006.911292:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401006.911293:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401006.911297:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401006.911302:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401006.911304:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747401006.911305:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085816064:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747401006.911343:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816000:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747401006.912073:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085816064:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1747401006.912117:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816000:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747401007.189476:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401008.191489:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747401008.495412:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747401008.495417:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 546 10000000:01000000:0.0:1747401008.495421:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747401008.495454:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747401008.495462:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747401008.495470:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747401008.495489:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816128:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747401008.495548:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012a528480 going to sleep for 6 seconds 00000100:00100000:2.0:1747401008.496789:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816128:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747401008.496801:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401008.496807:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747401008.496841:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816192:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747401008.496870:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e780 going to sleep for 6 seconds 00000100:00100000:2.0:1747401008.497494:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816192:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747401008.497515:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816256:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747401008.497556:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e780 going to sleep for 6 seconds 00000100:00100000:2.0:1747401008.498432:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816256:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747401008.498607:0:13360:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13360:1832281085816320:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747401008.498642:0:13360:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747401008.499910:0:13360:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13360:1832281085816320:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747401008.499933:0:13360:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747401008.499939:0:13360:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747401008.499940:0:13360:0:(obd_config.c:1460:class_process_config()) marker 357 (0x1) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000020:01000000:3.0:1747401008.499945:0:13360:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747401008.499947:0:13360:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747401008.499954:0:13360:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to testpool as member 2 00000100:00100000:3.0:1747401008.499967:0:13360:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13360:1832281085816384:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747401008.499999:0:13360:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012fc05180 going to sleep for 6 seconds 00000100:00100000:3.0:1747401008.500766:0:13360:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a79cc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:13360:1832281085816384:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747401008.500778:0:13360:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747401008.500780:0:13360:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747401008.500781:0:13360:0:(obd_config.c:1460:class_process_config()) marker 357 (0x2) lustre-clilov add lustre.testpool.lustre-OST0001_UUID 00000040:00080000:3.0:1747401008.500782:0:13360:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 549 count 537 00000020:01000000:2.0:1747401008.500829:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 546-548 (rc=0) 10000000:01000000:2.0:1747401008.500844:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747401008.500849:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401008.500857:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747401008.500863:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747401008.500865:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747401008.500870:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747401008.500883:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401008.500895:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401008.500901:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747401008.500910:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816448:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747401008.500934:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e780 going to sleep for 6 seconds 00000100:00100000:2.0:1747401008.501781:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816448:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747401008.501789:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401008.501794:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747401008.501817:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816512:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747401008.501846:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800a995e780 going to sleep for 6 seconds 00000100:00100000:2.0:1747401008.502643:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281085816512:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747401008.502677:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747401008.502682:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401008.502691:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747401009.193496:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401010.195539:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747401010.411495:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401010.411501:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747401010.411503:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401010.411505:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747401010.411531:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085816640:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747401010.411532:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816576:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747401010.412805:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816576:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747401010.412832:0:1865:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294998787 gen 1 00000100:00100000:2.0:1747401010.412848:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085816640:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1747401011.197577:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401012.199493:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401013.201474:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401014.203645:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747401015.205412:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747401015.419498:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401015.419503:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747401015.419504:0:4885:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401015.419506:0:4885:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747401015.419524:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816704:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747401015.419524:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085816768:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1747401015.420908:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816704:192.168.204.160@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1747401015.420916:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085816768:192.168.204.160@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1747401016.207523:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401017.209511:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401018.211513:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401019.213495:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401020.215478:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747401020.427464:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401020.427468:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747401020.427469:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401020.427471:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1747401020.427492:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816832:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747401020.427497:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085816896:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747401020.428742:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816832:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747401020.428773:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085816896:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747401021.217543:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401022.219569:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747401023.221475:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401024.223504:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401025.225466:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747401025.435464:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401025.435468:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747401025.435470:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747401025.435472:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747401025.435495:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085817024:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747401025.435499:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816960:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:3.0:1747401025.436801:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281085816960:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747401025.436815:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1865:1832281085817024:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747401026.227537:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747401026.668658:0:13324:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:13324:1832281085815936:192.168.204.160@tcp:101:createmany.0 00010000:00010000:2.0:1747401026.668675:0:13324:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668687:0:13324:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668692:0:13324:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668707:0:13324:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668711:0:13324:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668714:0:13324:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d7840 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747401026.668716:0:13324:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668719:0:13324:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668722:0:13324:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 5/0,0 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668726:0:13324:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747401026.668728:0:13324:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.668731:0:13324:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff8800a78d7840/0xd95e55596abf1620 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x28fc:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 13324 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747401026.668760:0:13324:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=17, status=-28 req@ffff88012d46d580 x1832281085815936/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747401037 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'createmany.0' 00000080:00200000:2.0:1747401026.668827:0:13324:0:(namei.c:1416:ll_create_it()) VFS Op:name=f22.ost-pools1, dir=[0x200000401:0x28fc:0x0](ffff8800af31d618), intent=open|creat 00000100:00100000:1.0:1747401026.908738:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747401026.908764:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747401026.908788:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090239360 00000100:00100000:1.0:1747401026.908812:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281090239424 00000100:00100000:1.0:1747401026.908820:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 282 00000100:00100000:1.0:1747401026.908824:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9af4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:32508:x1832281090239360:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747401026.908836:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747401026.908858:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 283 00000100:00100000:0.0:1747401026.908862:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9af0980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:32508:x1832281090239424:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747401026.908866:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747401026.908884:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747401026.908888:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9af4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:32508:x1832281090239360:12345-192.168.204.160@tcp:104: Request processed in 64us (154us total) trans 0 rc 0/0 00010000:00010000:2.0:1747401026.908889:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747401026.908893:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747401026.908894:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 282 00010000:00010000:2.0:1747401026.908902:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff8800a78d7a80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747401026.908905:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.908910:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747401026.908915:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747401026.908919:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747401026.908942:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.908945:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747401026.908957:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.908961:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff8800a78d7a80/0xd95e55596abf162e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbee4 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747401026.908964:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747401026.908968:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9af0980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:32508:x1832281090239424:12345-192.168.204.160@tcp:104: Request processed in 106us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1747401026.908969:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747401026.908970:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747401026.908973:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 283 00010000:00010000:2.0:1747401026.908974:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f0b40 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747401026.908975:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.908979:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747401026.908984:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1747401026.908990:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747401026.908993:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747401026.909005:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.909009:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747401026.909013:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.909016:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f0b40/0xd95e55596abf1627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6bbedd expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747401026.909025:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401026.909026:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747401026.909027:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747401026.909037:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085817152:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747401026.909074:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747401026.909078:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085817088:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747401026.909804:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085817152:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747401026.909920:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d46d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281085817088:192.168.204.160@tcp:103:ldlm_bl_01.0 00000400:00000080:3.0:1747401027.000630:0:13515:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747401027.000632:0:13515:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: ost-pools test_22: @@@@@@ FAIL: createmany /mnt/lustre/d22.ost-pools/f22.ost-pools failed! 00010000:00010000:2.0:1747401027.229604:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1624 lines, 1624 kept, 0 dropped, 0 bad.