00010000:00010000:2.0F:1747399983.067574:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0F:1747399983.771463:0:32257:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399983.771483:0:32257:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399983.771485:0:32257:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399983.771487:0:32257:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399983.771522:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081729472:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:0.0F:1747399983.771540:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081729408:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1747399983.772682:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081729472:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1747399983.772776:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081729408:192.168.204.160@tcp:400:kworker/u8:1.0 00010000:00010000:3.0F:1747399984.069928:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399984.221661:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399984.221704:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399984.221746:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089300352 00000100:00100000:0.0:1747399984.221776:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089300416 00000100:00100000:0.0:1747399984.221784:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 179 00000100:00100000:0.0:1747399984.221788:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:9127:x1832281089300352:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399984.221800:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399984.221852:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1747399984.221856:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:9127:x1832281089300352:12345-192.168.204.160@tcp:104: Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399984.221862:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 179 00000100:00100000:0.0:1747399984.221877:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 180 00000100:00100000:0.0:1747399984.221881:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:9127:x1832281089300416:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399984.221885:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399984.221915:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399984.221919:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:9127:x1832281089300416:12345-192.168.204.160@tcp:104: Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399984.221924:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 180 00010000:00010000:3.0:1747399984.221947:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399984.221951:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399984.221958:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399984.221960:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399984.221966:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399984.221971:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399984.221975:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399984.222066:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399984.222070:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399984.222080:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747399984.222083:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399984.222085:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399984.222088:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45aac0 already unused, calling callback (ffffffffa05055c0) 00010000:00010000:3.0:1747399984.222089:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607191 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399984.222090:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399984.222094:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399984.222098:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399984.222100:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399984.222100:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399984.222101:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747399984.222101:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1747399984.222106:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1747399984.222118:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081729536:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747399984.222127:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399984.222131:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399984.222133:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399984.222137:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf20a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60718a expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399984.222147:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399984.222148:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399984.222149:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399984.222152:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081729600:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399984.224144:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aad0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081729600:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399984.224152:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081729536:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1747399985.071618:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1747399985.865402:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399985.865406:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 362 10000000:01000000:1.0:1747399985.865411:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399985.865443:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399985.865451:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399985.865460:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399985.865481:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081729664:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399985.865543:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34480 going to sleep for 6 seconds 00000100:00100000:1.0:1747399985.868012:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081729664:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399985.868039:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399985.868049:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399985.868122:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081729728:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399985.868194:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34480 going to sleep for 6 seconds 00000100:00100000:1.0:1747399985.873777:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081729728:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399985.873844:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081729792:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399985.874482:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34480 going to sleep for 6 seconds 00000100:00100000:1.0:1747399985.877847:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081729792:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399985.878282:0:32480:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32480:1832281081729856:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399985.878646:0:32480:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34480 going to sleep for 6 seconds 00000100:00100000:1.0:1747399985.881529:0:32480:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32480:1832281081729856:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399985.881574:0:32480:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1747399985.881582:0:32480:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399985.881584:0:32480:0:(obd_config.c:1460:class_process_config()) marker 237 (0x1) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000020:01000000:1.0:1747399985.881589:0:32480:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:1.0:1747399985.881591:0:32480:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1747399985.881602:0:32480:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from testpool 00000100:00100000:1.0:1747399985.881631:0:32480:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32480:1832281081729920:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:1.0:1747399985.881702:0:32480:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34480 going to sleep for 6 seconds 00000100:00100000:1.0:1747399985.883685:0:32480:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32480:1832281081729920:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:1.0:1747399985.883733:0:32480:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1747399985.883739:0:32480:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1747399985.883741:0:32480:0:(obd_config.c:1460:class_process_config()) marker 237 (0x2) lustre-clilov rem lustre.testpool.lustre-OST0000_UUID 00000040:00080000:1.0:1747399985.883744:0:32480:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 365 count 357 00000020:01000000:2.0:1747399985.884778:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 362-364 (rc=0) 10000000:01000000:2.0:1747399985.884800:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399985.884808:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399985.884831:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399985.884839:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399985.884841:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399985.884844:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399985.884873:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399985.884878:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399985.884886:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399985.884903:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081729984:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399985.884976:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399985.886439:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081729984:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399985.886460:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399985.886470:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399985.886529:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730048:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399985.886770:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbb40 going to sleep for 6 seconds 00000100:00100000:2.0:1747399985.887991:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730048:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399985.888033:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399985.888039:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399985.888047:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399986.073656:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399986.818088:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399986.818180:0:4655:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747399986.818205:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089304000 00000100:00100000:1.0:1747399986.818256:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 181 00000100:00100000:1.0:1747399986.818261:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:9285:x1832281089304000:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399986.818277:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399986.818379:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747399986.818384:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:9285:x1832281089304000:12345-192.168.204.160@tcp:104: Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399986.818388:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747399986.818389:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 181 00000100:00100000:1.0:1747399986.818429:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089304064 00000100:00100000:1.0:1747399986.818440:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 182 00000100:00100000:1.0:1747399986.818443:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:9285:x1832281089304064:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747399986.818448:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399986.818484:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399986.818488:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:9285:x1832281089304064:12345-192.168.204.160@tcp:104: Request processed in 44us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399986.818493:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 182 00010000:00010000:3.0:1747399986.818563:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399986.818569:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399986.818576:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f5f80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399986.818579:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399986.818586:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399986.818586:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1747399986.818591:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399986.818594:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399986.818596:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399986.818605:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45aac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399986.818607:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399986.818615:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747399986.818623:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399986.818627:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399986.818640:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399986.818645:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399986.818661:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399986.818662:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399986.818666:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f5f80/0xd95e55596abdf273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607319 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399986.818666:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747399986.818688:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399986.818692:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45aac0/0xd95e55596abdf26c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607312 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399986.818735:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399986.818736:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399986.818738:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399986.818755:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081730112:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747399986.818817:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747399986.818821:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081730176:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1747399986.818863:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399986.818870:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399986.818872:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747399986.820747:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081730176:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747399986.820757:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf60e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081730112:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1747399987.075467:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1747399987.611417:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1747399987.611432:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 365 10000000:01000000:0.0:1747399987.611437:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1747399987.611467:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399987.611475:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399987.611483:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747399987.611502:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730240:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747399987.611569:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6753c00 going to sleep for 6 seconds 00000100:00100000:2.0:1747399987.615502:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730240:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399987.615523:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399987.615532:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399987.615594:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730304:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399987.616156:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399987.620752:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730304:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399987.620799:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730368:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747399987.620871:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399987.627527:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730368:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399987.627898:0:32499:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32499:1832281081730432:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399987.628695:0:32499:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399987.633079:0:32499:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32499:1832281081730432:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399987.633111:0:32499:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399987.633118:0:32499:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399987.633120:0:32499:0:(obd_config.c:1460:class_process_config()) marker 239 (0x1) lustre-clilov del lustre.testpool 00000020:01000000:3.0:1747399987.633124:0:32499:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399987.633126:0:32499:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399987.633178:0:32499:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32499:1832281081730496:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399987.633240:0:32499:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747399987.634775:0:32499:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32499:1832281081730496:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399987.634797:0:32499:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399987.634801:0:32499:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399987.634803:0:32499:0:(obd_config.c:1460:class_process_config()) marker 239 (0x2) lustre-clilov del lustre.testpool 00000040:00080000:3.0:1747399987.634805:0:32499:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 368 count 360 00000020:01000000:2.0:1747399987.634859:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 365-367 (rc=0) 10000000:01000000:2.0:1747399987.634876:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747399987.634881:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399987.634889:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399987.634896:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747399987.634897:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747399987.634899:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747399987.634915:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399987.634920:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399987.634927:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399987.634938:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730560:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747399987.634979:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399987.640228:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730560:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747399987.640258:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399987.640269:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747399987.640367:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730624:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747399987.640806:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb000 going to sleep for 6 seconds 00000100:00100000:2.0:1747399987.642759:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730624:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747399987.642959:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747399987.642966:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399987.642974:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399988.078252:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1747399988.779467:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399988.779472:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:1.0:1747399988.779473:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1747399988.779475:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399988.779505:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081730752:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399988.779573:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1747399988.779589:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081730688:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399988.782270:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af5f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081730688:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399988.782493:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081730752:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:3.0:1747399989.080154:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399989.349818:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399989.349878:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399989.349920:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089306880 00000100:00100000:0.0:1747399989.349961:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089307072 00000100:00100000:0.0:1747399989.349972:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 183 00000100:00100000:0.0:1747399989.349978:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:9553:x1832281089306880:12345-192.168.204.160@tcp:104: 00000100:00100000:1.0:1747399989.349985:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 184 00000100:00100000:1.0:1747399989.349990:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:9553:x1832281089307072:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399989.349993:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.349997:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399989.350507:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399989.350513:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:9553:x1832281089306880:12345-192.168.204.160@tcp:104: Request processed in 535us (704us total) trans 0 rc 0/0 00010000:00010000:3.0:1747399989.350516:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1747399989.350521:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 183 00010000:00010000:3.0:1747399989.350522:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399989.350529:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012e9f4fc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399989.350532:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399989.350538:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399989.350553:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399989.350557:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399989.350591:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399989.350597:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399989.350613:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.350616:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1747399989.350618:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6073ac expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399989.350622:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:9553:x1832281089307072:12345-192.168.204.160@tcp:104: Request processed in 631us (744us total) trans 0 rc 0/0 00010000:00010000:2.0:1747399989.350627:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1747399989.350627:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 184 00010000:00010000:2.0:1747399989.350643:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399989.350647:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399989.350648:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399989.350649:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399989.350652:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2ac0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747399989.350655:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399989.350662:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747399989.350665:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081730816:192.168.204.160@tcp:103:ldlm_bl_03.0 10000000:00010000:2.0:1747399989.350666:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747399989.350670:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1747399989.350702:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399989.350706:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1747399989.350725:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081730880:192.168.204.160@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1747399989.350735:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399989.350749:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2ac0/0xd95e55596abdf27a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607389 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747399989.350769:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399989.350770:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399989.350771:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399989.352433:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aab440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081730880:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:3.0:1747399989.352466:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081730816:192.168.204.160@tcp:103:ldlm_bl_03.0 10000000:01000000:1.0:1747399989.368503:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399989.368510:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 368 10000000:01000000:1.0:1747399989.368516:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399989.368562:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.368572:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.368582:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399989.368607:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730944:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399989.368721:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399989.371254:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081730944:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399989.371286:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.371295:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399989.371381:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731008:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399989.371433:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399989.372817:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731008:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399989.372870:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731072:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399989.372939:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399989.374233:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731072:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399989.375066:0:32563:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32563:1832281081731136:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399989.375140:0:32563:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399989.378360:0:32563:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32563:1832281081731136:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399989.378407:0:32563:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399989.378425:0:32563:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399989.378426:0:32563:0:(obd_config.c:1460:class_process_config()) marker 241 (0x1) lustre-clilov rem lustre.testpool2.lustre-OST0001_UUID 00000020:01000000:3.0:1747399989.378431:0:32563:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399989.378433:0:32563:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1747399989.378446:0:32563:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from testpool2 00000100:00100000:3.0:1747399989.378479:0:32563:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32563:1832281081731200:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399989.378549:0:32563:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b780 going to sleep for 6 seconds 00000100:00100000:3.0:1747399989.380000:0:32563:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32563:1832281081731200:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399989.380035:0:32563:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399989.380041:0:32563:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399989.380042:0:32563:0:(obd_config.c:1460:class_process_config()) marker 241 (0x2) lustre-clilov rem lustre.testpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1747399989.380045:0:32563:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 371 count 363 00000020:01000000:1.0:1747399989.380194:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 368-370 (rc=0) 10000000:01000000:1.0:1747399989.380214:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399989.380221:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.380229:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399989.380236:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399989.380238:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399989.380239:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399989.380260:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.380264:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.380277:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399989.380289:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731264:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399989.380352:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399989.381788:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731264:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399989.381810:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.381819:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399989.381875:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731328:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399989.381921:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f34540 going to sleep for 6 seconds 00000100:00100000:1.0:1747399989.383037:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731328:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399989.383061:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399989.383065:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399989.383071:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399990.081712:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399991.086270:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747399991.087026:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399991.087066:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747399991.087085:0:4656:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089309952 00000100:00100000:1.0:1747399991.087086:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089309888 00000100:00100000:0.0:1747399991.087115:0:4656:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 185 00000100:00100000:1.0:1747399991.087119:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 186 00000100:00100000:0.0:1747399991.087119:0:4656:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:9695:x1832281089309952:12345-192.168.204.160@tcp:104: 00000100:00100000:1.0:1747399991.087123:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:9695:x1832281089309888:12345-192.168.204.160@tcp:104: 00010000:00010000:0.0:1747399991.087130:0:4656:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.087134:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747399991.087183:0:4656:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747399991.087187:0:4656:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b80d169-0905-4300-a34c-b155594364e5+4:9695:x1832281089309952:12345-192.168.204.160@tcp:104: Request processed in 68us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1747399991.087193:0:4656:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 185 00010000:00010000:1.0:1747399991.087197:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1747399991.087201:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:9695:x1832281089309888:12345-192.168.204.160@tcp:104: Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1747399991.087206:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 186 00010000:00010000:3.0:1747399991.087230:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1747399991.087234:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087241:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b180 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399991.087243:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087249:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399991.087253:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399991.087257:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399991.087293:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087303:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399991.087334:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087340:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45b180/0xd95e55596abdf288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607400 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087353:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1747399991.087354:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087358:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45bcc0 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:3.0:1747399991.087359:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087363:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1747399991.087367:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1747399991.087371:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1747399991.087380:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087384:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1747399991.087387:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087390:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45bcc0/0xd95e55596abdf28f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607407 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399991.087408:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399991.087409:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399991.087410:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399991.087424:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081731392:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399991.087476:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1747399991.087481:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081731456:192.168.204.160@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1747399991.087824:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747399991.093677:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081731456:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:3.0:1747399991.093689:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081731392:192.168.204.160@tcp:103:ldlm_bl_02.0 10000000:01000000:1.0:1747399991.206731:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1747399991.206736:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 371 10000000:01000000:1.0:1747399991.206741:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1747399991.206774:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.206787:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.206796:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399991.206816:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731520:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399991.207510:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399991.209459:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731520:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399991.209477:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.209486:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399991.209528:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731584:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399991.209626:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399991.212498:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731584:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399991.212544:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731648:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1747399991.212817:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399991.215112:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731648:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747399991.215679:0:32582:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32582:1832281081731712:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399991.216730:0:32582:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bd80 going to sleep for 6 seconds 00000100:00100000:3.0:1747399991.221358:0:32582:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32582:1832281081731712:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399991.221392:0:32582:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747399991.221399:0:32582:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399991.221401:0:32582:0:(obd_config.c:1460:class_process_config()) marker 243 (0x1) lustre-clilov del lustre.testpool2 00000020:01000000:3.0:1747399991.221406:0:32582:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747399991.221408:0:32582:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1747399991.221451:0:32582:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32582:1832281081731776:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747399991.221503:0:32582:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b900 going to sleep for 6 seconds 00000100:00100000:3.0:1747399991.222902:0:32582:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:32582:1832281081731776:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747399991.222923:0:32582:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747399991.222927:0:32582:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747399991.222927:0:32582:0:(obd_config.c:1460:class_process_config()) marker 243 (0x2) lustre-clilov del lustre.testpool2 00000040:00080000:3.0:1747399991.222934:0:32582:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 374 count 366 00000020:01000000:1.0:1747399991.223260:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 371-373 (rc=0) 10000000:01000000:1.0:1747399991.223278:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1747399991.223283:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.223292:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1747399991.223299:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1747399991.223301:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:1.0:1747399991.223303:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1747399991.223340:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.223345:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.223352:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399991.223364:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731840:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1747399991.223404:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399991.226335:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731840:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1747399991.226356:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.226365:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747399991.226422:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731904:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1747399991.226481:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800b6f349c0 going to sleep for 6 seconds 00000100:00100000:1.0:1747399991.232380:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081731904:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1747399991.232414:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1747399991.232420:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747399991.232427:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747399992.087666:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399993.089493:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1747399993.788197:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399993.788202:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:2.0:1747399993.788204:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1747399993.788206:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1747399993.788226:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081732032:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399993.788295:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747399993.788301:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081731968:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399993.791926:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081731968:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1747399993.791942:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1864:1832281081732032:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747399994.091733:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1747399995.094509:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747399996.095591:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399996.564559:0:404:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399996.564563:0:404:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 12: OST Pool Membership ================ 08:53:16 (1747399996) 00010000:00010000:2.0:1747399997.097475:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1747399997.162859:0:562:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1747399997.162862:0:562:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: ost-pools test_12 needs >=3 OSTs 00000400:00000080:3.0:1747399997.876726:0:735:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399997.876729:0:735:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 13: Striping characteristics in a pool ========================================================== 08:53:17 (1747399997) 00010000:00010000:2.0:1747399998.099655:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399998.404188:0:912:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399998.404191:0:912:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: ost-pools test_13 needs >= 3 OSTs 00000100:00080000:0.0:1747399998.795497:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399998.795501:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747399998.795503:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747399998.795505:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747399998.795567:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081732096:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747399998.795626:0:1862:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1747399998.795631:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081732160:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399998.797147:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1862:1832281081732160:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747399998.797156:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081732096:192.168.204.160@tcp:400:kworker/u8:3.0 00000400:00000080:3.0:1747399999.068256:0:1082:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399999.068261:0:1082:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 14: Round robin and QOS striping within a pool ========================================================== 08:53:18 (1747399998) 00010000:00010000:3.0:1747399999.101436:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747399999.561435:0:1234:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747399999.561451:0:1234:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: ost-pools test_14 needs >= 3 OSTs 00010000:00010000:2.0:1747400000.103458:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747400000.160638:0:1402:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747400000.160642:0:1402:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == ost-pools test 15: One directory per OST/pool ========= 08:53:19 (1747399999) 00000100:00100000:0.0:1747400000.558879:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400000.559152:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089313536 00000100:00100000:1.0:1747400000.559194:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 187 00000100:00100000:1.0:1747400000.559200:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:10668:x1832281089313536:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400000.559215:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400000.559307:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747400000.559345:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+3:10668:x1832281089313536:12345-192.168.204.160@tcp:104: Request processed in 145us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400000.559351:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 187 00010000:00010000:2.0:1747400000.559361:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747400000.559369:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.559486:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45b840 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400000.559489:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.559497:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400000.559502:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400000.559505:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1747400000.559573:0:1855:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:1.0:1747400000.559667:0:29517:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1747400000.559681:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089313600 00000100:00100000:1.0:1747400000.559697:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 188 00000100:00100000:1.0:1747400000.559700:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aafe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:10668:x1832281089313600:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400000.559707:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.559773:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.559779:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747400000.559795:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400000.559857:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081732224:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747400000.559959:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45b840/0xd95e55596abdf29d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf60747e expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400000.559977:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747400000.559983:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aafe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:10668:x1832281089313600:12345-192.168.204.160@tcp:104: Request processed in 281us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1747400000.559989:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 188 00010000:00010000:2.0:1747400000.560081:0:8848:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1747400000.560083:0:8848:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.560087:0:8848:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b45ba80 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400000.560088:0:8848:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.560092:0:8848:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400000.560104:0:8848:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400000.560107:0:8848:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1747400000.560189:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400000.560922:0:8848:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.560929:0:8848:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1747400000.560948:0:8848:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.560953:0:8848:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b45ba80/0xd95e55596abdf296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf607477 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400000.560964:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400000.560965:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400000.560967:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1747400000.560978:0:1865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1747400000.560986:0:1865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081732288:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747400000.561573:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081732224:192.168.204.160@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1747400000.562696:0:1865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7b80d169-0905-4300-a34c-b155594364e5:1865:1832281081732288:192.168.204.160@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1747400001.106289:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1747400001.606444:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1747400001.606449:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 374 10000000:01000000:3.0:1747400001.606453:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1747400001.606490:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400001.606499:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400001.606506:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400001.606526:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732352:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1747400001.607372:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747400001.610248:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732352:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1747400001.610271:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400001.610281:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400001.610368:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732416:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747400001.610442:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747400001.612642:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732416:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1747400001.612699:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732480:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400001.612774:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747400001.614161:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732480:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400001.614579:0:1433:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:1433:1832281081732544:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400001.614644:0:1433:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b600 going to sleep for 6 seconds 00000100:00100000:3.0:1747400001.617461:0:1433:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:1433:1832281081732544:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400001.617505:0:1433:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400001.617516:0:1433:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400001.617517:0:1433:0:(obd_config.c:1460:class_process_config()) marker 245 (0x1) lustre-clilov new lustre.testpool0 00000020:01000000:3.0:1747400001.617522:0:1433:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400001.617524:0:1433:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1747400001.617544:0:1433:0:(lov_pool.c:313:lov_pool_new()) testpool0 is pool #1 00000100:00100000:3.0:1747400001.617577:0:1433:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:1433:1832281081732608:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400001.617648:0:1433:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b540 going to sleep for 6 seconds 00000100:00100000:3.0:1747400001.620377:0:1433:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:1433:1832281081732608:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400001.620431:0:1433:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400001.620439:0:1433:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400001.620441:0:1433:0:(obd_config.c:1460:class_process_config()) marker 245 (0x2) lustre-clilov new lustre.testpool0 00000040:00080000:3.0:1747400001.620445:0:1433:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 377 count 369 00000020:01000000:0.0:1747400001.620612:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 374-376 (rc=0) 10000000:01000000:0.0:1747400001.620632:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1747400001.620641:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400001.620652:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1747400001.620671:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1747400001.620673:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:0.0:1747400001.620676:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1747400001.620704:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400001.620709:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400001.620716:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400001.620735:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732672:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1747400001.620800:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012a528180 going to sleep for 6 seconds 00000100:00100000:0.0:1747400001.624805:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732672:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1747400001.624837:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400001.624849:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1747400001.624929:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732736:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1747400001.624999:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012a528180 going to sleep for 6 seconds 00000100:00100000:2.0:1747400001.630865:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732736:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400001.630903:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400001.630910:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400001.630931:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400002.108360:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400003.113362:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1747400003.450769:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400003.450818:0:1854:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.160@tcp (source: 12345-192.168.204.160@tcp) 00000100:00100000:0.0:1747400003.450842:0:4655:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089316608 00000100:00100000:1.0:1747400003.450843:0:29517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1832281089316544 00000100:00100000:1.0:1747400003.450872:0:29517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 189 00000100:00100000:1.0:1747400003.450877:0:29517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+4:10874:x1832281089316544:12345-192.168.204.160@tcp:104: 00000100:00100000:0.0:1747400003.450877:0:4655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.160@tcp, seq: 190 00000100:00100000:0.0:1747400003.450888:0:4655:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:10874:x1832281089316608:12345-192.168.204.160@tcp:104: 00010000:00010000:1.0:1747400003.450889:0:29517:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400003.450894:0:4655:0:(ldlm_lockd.c:2469:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1747400003.451170:0:4655:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1747400003.451174:0:4655:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b80d169-0905-4300-a34c-b155594364e5+4:10874:x1832281089316608:12345-192.168.204.160@tcp:104: Request processed in 286us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1747400003.451179:0:4655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 190 00010000:00010000:2.0:1747400003.451441:0:4665:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1747400003.451445:0:4665:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400003.451445:0:29517:0:(ldlm_lockd.c:2160:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1747400003.451450:0:29517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7b80d169-0905-4300-a34c-b155594364e5+3:10874:x1832281089316544:12345-192.168.204.160@tcp:104: Request processed in 573us (687us total) trans 0 rc 0/0 00010000:00010000:2.0:1747400003.451451:0:4665:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21680 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:2.0:1747400003.451453:0:4665:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1747400003.451456:0:29517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.160@tcp, seq: 189 00010000:00010000:2.0:1747400003.451459:0:4665:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1747400003.451463:0:4665:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400003.451467:0:4665:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747400003.451470:0:4666:0:(ldlm_lockd.c:2790:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1747400003.451477:0:4666:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400003.451482:0:4666:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff88012b1f2880 already unused, calling callback (ffffffffa05055c0) 10000000:00010000:1.0:1747400003.451484:0:4666:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400003.451488:0:4666:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400003.451492:0:4665:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1747400003.451493:0:4666:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400003.451496:0:4665:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1747400003.451496:0:4666:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1747400003.451508:0:4666:0:(ldlm_request.c:1282:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400003.451512:0:4666:0:(ldlm_request.c:1328:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1747400003.451522:0:4666:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400003.451523:0:4665:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400003.451527:0:4666:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff88012b1f2880/0xd95e55596abdf2ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6074f5 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400003.451528:0:4665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff880136b21680/0xd95e55596abdf2a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb255fa25cf6074ee expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400003.451540:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747400003.451540:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747400003.451541:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400003.451542:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400003.451543:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400003.451549:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1747400003.451553:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081732864:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1747400003.451574:0:1864:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1747400003.451583:0:1864:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081732800:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1747400003.453765:0:1864:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7b80d169-0905-4300-a34c-b155594364e5:1864:1832281081732800:192.168.204.160@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1747400003.453827:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9af63c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081732864:192.168.204.160@tcp:103:ldlm_bl_02.0 00000100:00080000:0.0:1747400003.803602:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400003.803607:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747400003.803609:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400003.803611:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1747400003.803768:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081732928:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747400003.806355:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081732928:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747400004.114945:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1747400004.945906:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1747400004.945913:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b65c8800 from 377 10000000:01000000:2.0:1747400004.945919:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1747400004.945964:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400004.945973:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400004.945982:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400004.946006:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732992:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400004.946091:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747400004.948640:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081732992:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400004.948666:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6075c7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400004.948676:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6075c7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400004.948750:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081733056:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400004.948813:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747400004.951826:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081733056:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400004.951896:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081733120:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1747400004.952030:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747400004.955905:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081733120:192.168.204.160@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1747400004.957085:0:1497:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:1497:1832281081733184:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400004.957180:0:1497:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747400004.959279:0:1497:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:1497:1832281081733184:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400004.959482:0:1497:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1747400004.959492:0:1497:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400004.959493:0:1497:0:(obd_config.c:1460:class_process_config()) marker 247 (0x1) lustre-clilov add lustre.testpool0.lustre-OST0000_UUID 00000020:01000000:3.0:1747400004.959498:0:1497:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b65c8800 00000020:00000080:3.0:1747400004.959501:0:1497:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1747400004.959513:0:1497:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to testpool0 as member 1 00000100:00100000:3.0:1747400004.959545:0:1497:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:1497:1832281081733248:192.168.204.160@tcp:502:llog_process_th.0 00000100:00100000:3.0:1747400004.959615:0:1497:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5b0c0 going to sleep for 6 seconds 00000100:00100000:3.0:1747400004.962614:0:1497:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b80d169-0905-4300-a34c-b155594364e5:1497:1832281081733248:192.168.204.160@tcp:502:llog_process_th.0 00000020:01000000:3.0:1747400004.962658:0:1497:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1747400004.962665:0:1497:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1747400004.962667:0:1497:0:(obd_config.c:1460:class_process_config()) marker 247 (0x2) lustre-clilov add lustre.testpool0.lustre-OST0000_UUID 00000040:00080000:3.0:1747400004.962671:0:1497:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 380 count 372 00000020:01000000:2.0:1747400004.963827:0:4669:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 377-379 (rc=0) 10000000:01000000:2.0:1747400004.963856:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1747400004.963863:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf2b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6075c7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400004.963875:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f4fc0/0xd95e55596abdf2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6075c7 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1747400004.963883:0:4669:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1747400004.963885:0:4669:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa478000 from 1 10000000:01000000:2.0:1747400004.963888:0:4669:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1747400004.963918:0:4669:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdf2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400004.963924:0:4669:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdf2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400004.963931:0:4669:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdf2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400004.963952:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081733312:192.168.204.160@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1747400004.964017:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747400004.967976:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081733312:192.168.204.160@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1747400004.968001:0:4669:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdf2b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6075ce expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400004.968021:0:4669:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdf2b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb255fa25cf6075ce expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1747400004.968095:0:4669:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081733376:192.168.204.160@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1747400004.968158:0:4669:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbb3c0 going to sleep for 6 seconds 00000100:00100000:2.0:1747400004.969810:0:4669:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b80d169-0905-4300-a34c-b155594364e5:4669:1832281081733376:192.168.204.160@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1747400004.969852:0:4669:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1747400004.969859:0:4669:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdf2b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6075ce expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400004.969868:0:4669:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff88012e9f5200/0xd95e55596abdf2b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb255fa25cf6075ce expref: -99 pid: 4669 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1747400005.115813:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1747400005.905472:0:1507:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.905494:0:1507:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.905508:0:1507:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.905524:0:1507:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.905534:0:1507:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.905536:0:1507:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.905542:0:1507:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012a4a7e00 00010000:00010000:3.0:1747400005.905545:0:1507:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.905551:0:1507:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.905566:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 101 00000080:00200000:3.0:1747400005.905574:0:1507:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.905578:0:1507:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.905582:0:1507:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.905587:0:1507:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.905592:0:1507:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.905594:0:1507:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.905596:0:1507:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012a4a7b58 00010000:00010000:3.0:1747400005.905597:0:1507:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.905601:0:1507:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.905612:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.905619:0:1507:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=1536 00000080:00200000:3.0:1747400005.905623:0:1507:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.905627:0:1507:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.905630:0:1507:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.905635:0:1507:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.905640:0:1507:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.905641:0:1507:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.905643:0:1507:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012a4a7bf0 00010000:00010000:3.0:1747400005.905645:0:1507:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.905648:0:1507:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.905653:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747400005.905656:0:1507:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.905658:0:1507:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.905660:0:1507:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.905664:0:1507:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.905677:0:1507:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.905679:0:1507:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.905681:0:1507:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012a4a7da0 00010000:00010000:3.0:1747400005.905683:0:1507:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.905687:0:1507:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.905693:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 3 00000080:00200000:3.0:1747400005.905696:0:1507:0:(namei.c:1935:ll_mkdir()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8) 00000020:00100000:3.0:1747400005.905751:0:1507:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747400005.905761:0:1507:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf617c0 x1832281081733504/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747400005.905782:0:1507:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1507:1832281081733504:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:3.0:1747400005.905963:0:1507:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bc00 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.909258:0:1507:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf617c0 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1507:1832281081733504:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:3.0:1747400005.909298:0:1507:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58) 00000080:00200000:3.0:1747400005.909303:0:1507:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x21:0x0], updating i_size 512 00000080:00200000:3.0:1747400005.909398:0:1507:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.909412:0:1507:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.909425:0:1507:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.909437:0:1507:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.909457:0:1507:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.909459:0:1507:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.909465:0:1507:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012a4a7bb0 00010000:00010000:3.0:1747400005.909467:0:1507:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.909473:0:1507:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.909485:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.909498:0:1507:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), file ffff8800b6f73080, open_flags 38900, mode 0 opened 0 00000080:00200000:3.0:1747400005.909504:0:1507:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=open 00000002:00010000:3.0:1747400005.909512:0:1507:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d15.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0704401 00010000:00010000:3.0:1747400005.909557:0:1507:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.909563:0:1507:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747400005.909572:0:1507:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747400005.909578:0:1507:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf61300 x1832281081733632/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747400005.909585:0:1507:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400005.909602:0:1507:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1507:1832281081733632:192.168.204.160@tcp:101:mkdir.0 00000100:00100000:3.0:1747400005.909710:0:1507:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5bc00 going to sleep for 43 seconds 00000100:00100000:2.0:1747400005.911998:0:1507:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1507:1832281081733632:192.168.204.160@tcp:101:mkdir.0 00010000:00010000:2.0:1747400005.912015:0:1507:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912027:0:1507:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912032:0:1507:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912036:0:1507:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912041:0:1507:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912055:0:1507:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21440 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:2.0:1747400005.912058:0:1507:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912063:0:1507:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912069:0:1507:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912074:0:1507:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1747400005.912079:0:1507:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1747400005.912084:0:1507:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1507 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1747400005.912099:0:1507:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf61300 x1832281081733632/t4294967403(4294967403) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000002:00100000:2.0:1747400005.912109:0:1507:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf61300 x1832281081733632/t4294967403(4294967403) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000080:00200000:2.0:1747400005.912135:0:1507:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x21:0x0], updating i_size 512 00000080:00200000:2.0:1747400005.912138:0:1507:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x21:0x0](ffff880136f92f58): rc = 0 00000080:00010000:2.0:1747400005.912142:0:1507:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x21:0x0](ffff880136f92f58) for lock 0x0 00000080:00200000:2.0:1747400005.912160:0:1507:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), flags 704400 00000002:00100000:2.0:1747400005.912171:0:1507:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf61300 x1832281081733632/t4294967403(4294967403) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'mkdir.0' 00000080:00200000:2.0:1747400005.912351:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 44 00000080:00200000:2.0:1747400005.912380:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 101 00000080:00200000:2.0:1747400005.912394:0:1507:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58) 00000002:00100000:2.0:1747400005.912422:0:1507:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf61300 x1832281081733632/t4294967403(4294967403) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400049 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'mkdir.0' 00000020:00100000:2.0:1747400005.912442:0:1507:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1747400005.912446:0:1507:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b3aaa140 x1832281081733760/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1747400005.912464:0:1507:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1507:1832281081733760:192.168.204.160@tcp:35:mkdir.0 00000100:00100000:2.0:1747400005.912523:0:1507:0:(client.c:2500:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 6 seconds 00000100:00100000:3.0:1747400005.916003:0:1507:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800b3aaa140 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1507:1832281081733760:192.168.204.160@tcp:35:mkdir.0 00000002:00100000:3.0:1747400005.916026:0:1507:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf61300 x1832281081733632/t4294967403(4294967403) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400049 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'mkdir.0' 00000080:00200000:3.0:1747400005.916062:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.916070:0:1507:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), flags=1536 00000080:00200000:3.0:1747400005.916072:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 3 00000080:00200000:3.0:1747400005.916075:0:1507:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 3 00000080:00200000:3.0:1747400005.916077:0:1507:0:(namei.c:1935:ll_mkdir()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58) 00000020:00100000:3.0:1747400005.916115:0:1507:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747400005.916118:0:1507:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf61300 x1832281081733888/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 504/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747400005.916132:0:1507:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1507:1832281081733888:192.168.204.160@tcp:36:mkdir.0 00000100:00100000:3.0:1747400005.916201:0:1507:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.918620:0:1507:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61300 pname:cluuid:pid:xid:nid:opc:job mkdir:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1507:1832281081733888:192.168.204.160@tcp:36:mkdir.0 00000080:00200000:3.0:1747400005.918661:0:1507:0:(llite_lib.c:2848:ll_read_inode2()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718) 00000080:00200000:3.0:1747400005.918666:0:1507:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:3.0:1747400005.924194:0:1508:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.924213:0:1508:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.924225:0:1508:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.924237:0:1508:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.924246:0:1508:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.924249:0:1508:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.924259:0:1508:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012d673bb0 00010000:00010000:3.0:1747400005.924262:0:1508:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.924267:0:1508:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.924280:0:1508:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.924288:0:1508:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), flags=17 00000080:00200000:3.0:1747400005.924292:0:1508:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d15.ost-pools, dir=[0x200000007:0x1:0x0](ffff880136f900d8), intent=0 00000002:00010000:3.0:1747400005.924298:0:1508:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d15.ost-pools,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.925379:0:1508:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.925390:0:1508:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.925399:0:1508:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400005.925423:0:1508:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081733952:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747400005.925508:0:1508:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.927386:0:1508:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081733952:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747400005.927403:0:1508:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927417:0:1508:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927429:0:1508:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927435:0:1508:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927440:0:1508:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927445:0:1508:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927449:0:1508:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927453:0:1508:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747400005.927459:0:1508:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff88012bf62140 x1832281081733952/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 584/640 e 0 to 0 dl 1747400049 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1747400005.927466:0:1508:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927471:0:1508:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/33 (0 0) 00000080:00200000:3.0:1747400005.927493:0:1508:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x21:0x0], updating i_size 512 00000080:00200000:3.0:1747400005.927495:0:1508:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x21:0x0](ffff880136f92f58): rc = 0 00000080:00010000:3.0:1747400005.927499:0:1508:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x21:0x0](ffff880136f92f58) for lock 0xd95e55596abdf2c7 00000080:00010000:3.0:1747400005.927506:0:1508:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x21:0x0](ffff880136f92f58) 00000080:00010000:3.0:1747400005.927510:0:1508:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf2c7 from it ffff88012d673b20 00010000:00010000:3.0:1747400005.927512:0:1508:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927517:0:1508:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20fc0/0xd95e55596abdf2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf607622 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.927540:0:1508:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.927552:0:1508:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 3 00000080:00200000:3.0:1747400005.927556:0:1508:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), file ffff8800b6d2bb00, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1747400005.927562:0:1508:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), intent=open|creat 00000002:00010000:3.0:1747400005.927575:0:1508:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x200000401:0x23:0x0]) in obj [0x200000401:0x21:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1747400005.927608:0:1508:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.927613:0:1508:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747400005.927622:0:1508:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747400005.927626:0:1508:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62140 x1832281081734080/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747400005.927631:0:1508:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400005.927646:0:1508:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081734080:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747400005.928303:0:1508:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.930503:0:1508:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081734080:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747400005.930522:0:1508:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930542:0:1508:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930548:0:1508:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930553:0:1508:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 3/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930559:0:1508:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 4/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930563:0:1508:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b20b40 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747400005.930566:0:1508:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 4/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930571:0:1508:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 4/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930576:0:1508:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 5/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930581:0:1508:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747400005.930584:0:1508:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 3/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930588:0:1508:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747400005.930611:0:1508:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff88012bf62140 x1832281081734080/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400049 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747400005.930716:0:1508:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.930728:0:1508:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.930737:0:1508:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930744:0:1508:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.930750:0:1508:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.930752:0:1508:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.930755:0:1508:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012d673bb0 00010000:00010000:3.0:1747400005.930757:0:1508:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930762:0:1508:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.930772:0:1508:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.930777:0:1508:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d15.ost-pools, flags=19 00000080:00200000:3.0:1747400005.930779:0:1508:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.930787:0:1508:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), file ffff8800b6d2b200, open_flags 1a100, mode 0 opened 0 00000080:00200000:3.0:1747400005.930791:0:1508:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), intent=open 00000002:00010000:3.0:1747400005.930797:0:1508:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x0:0x0:0x0]) in obj [0x200000401:0x21:0x0], intent: open flags 0320401 00010000:00010000:3.0:1747400005.930827:0:1508:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.930841:0:1508:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747400005.930850:0:1508:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747400005.930854:0:1508:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62140 x1832281081734208/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747400005.930860:0:1508:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400005.930876:0:1508:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081734208:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747400005.931426:0:1508:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.935236:0:1508:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081734208:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747400005.935258:0:1508:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935271:0:1508:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935275:0:1508:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935280:0:1508:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935286:0:1508:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935307:0:1508:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b20d80 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747400005.935359:0:1508:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935365:0:1508:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935371:0:1508:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935376:0:1508:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747400005.935379:0:1508:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.935383:0:1508:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1508 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747400005.935398:0:1508:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf62140 x1832281081734208/t4294967406(4294967406) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747400005.935407:0:1508:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf62140 x1832281081734208/t4294967406(4294967406) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747400005.935432:0:1508:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:3.0:1747400005.935434:0:1508:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x22:0x0](ffff880136f93718): rc = 0 00000080:00010000:3.0:1747400005.935438:0:1508:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x22:0x0](ffff880136f93718) for lock 0x0 00000080:00200000:3.0:1747400005.935456:0:1508:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), flags 320400 00000002:00100000:3.0:1747400005.935470:0:1508:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf62140 x1832281081734208/t4294967406(4294967406) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747400005.935533:0:1508:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), inode mode 41ed mask 44 00000080:00200000:3.0:1747400005.935569:0:1508:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), cmd=0x4008669a 00000020:00100000:3.0:1747400005.935611:0:1508:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1747400005.935615:0:1508:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62ac0 x1832281081734336/t0(0) o36->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 536/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747400005.935634:0:1508:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081734336:192.168.204.160@tcp:36:lfs.0 00000100:00100000:3.0:1747400005.935725:0:1508:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.938696:0:1508:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62ac0 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081734336:192.168.204.160@tcp:36:lfs.0 00000080:00200000:3.0:1747400005.938745:0:1508:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718) 00000002:00100000:3.0:1747400005.938779:0:1508:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf62140 x1832281081734208/t4294967406(4294967406) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400049 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:3.0:1747400005.938799:0:1508:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747400005.938803:0:1508:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62600 x1832281081734464/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747400005.938816:0:1508:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081734464:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747400005.938864:0:1508:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747400005.941706:0:1508:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1508:1832281081734464:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747400005.941728:0:1508:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf62140 x1832281081734208/t4294967406(4294967406) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 520/600 e 0 to 0 dl 1747400049 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:3.0:1747400005.947993:0:1509:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.948016:0:1509:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.948033:0:1509:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.948055:0:1509:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.948064:0:1509:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.948067:0:1509:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.948074:0:1509:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012a4a7bb0 00010000:00010000:3.0:1747400005.948077:0:1509:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.948083:0:1509:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.948097:0:1509:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.948105:0:1509:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d15.ost-pools, flags=19 00000080:00200000:3.0:1747400005.948107:0:1509:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.948114:0:1509:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), file ffff8800b64e2900, open_flags 18800, mode 0 opened 0 00000080:00200000:3.0:1747400005.948120:0:1509:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), intent=open 00000002:00010000:3.0:1747400005.948129:0:1509:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x0:0x0:0x0]) in obj [0x200000401:0x21:0x0], intent: open flags 0304001 00010000:00010000:3.0:1747400005.948176:0:1509:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.948183:0:1509:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747400005.948194:0:1509:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747400005.948203:0:1509:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62600 x1832281081734592/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747400005.948219:0:1509:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400005.948237:0:1509:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081734592:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747400005.948414:0:1509:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.955299:0:1509:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62600 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081734592:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747400005.955360:0:1509:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955373:0:1509:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955378:0:1509:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955383:0:1509:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955389:0:1509:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955394:0:1509:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b20d80 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747400005.955398:0:1509:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955403:0:1509:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955424:0:1509:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 5/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955430:0:1509:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747400005.955435:0:1509:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955439:0:1509:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20d80/0xd95e55596abdf2dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747400005.955454:0:1509:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf62600 x1832281081734592/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747400005.955464:0:1509:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf62600 x1832281081734592/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747400005.955493:0:1509:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:3.0:1747400005.955496:0:1509:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x22:0x0](ffff880136f93718): rc = 0 00000080:00010000:3.0:1747400005.955500:0:1509:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x22:0x0](ffff880136f93718) for lock 0x0 00000080:00200000:3.0:1747400005.955522:0:1509:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), flags 304000 00000002:00100000:3.0:1747400005.955536:0:1509:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf62600 x1832281081734592/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747400005.955610:0:1509:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), inode mode 41ed mask 44 00000080:00200000:3.0:1747400005.955645:0:1509:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.955655:0:1509:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.955667:0:1509:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955675:0:1509:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.955685:0:1509:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.955687:0:1509:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.955691:0:1509:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012a4a7bb0 00010000:00010000:3.0:1747400005.955693:0:1509:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955698:0:1509:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.955710:0:1509:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.955715:0:1509:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d15.ost-pools, flags=16 00000080:00200000:3.0:1747400005.955718:0:1509:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.955725:0:1509:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), file ffff8800b64e2480, open_flags 28800, mode 0 opened 0 00000080:00200000:3.0:1747400005.955729:0:1509:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), intent=open 00000002:00010000:3.0:1747400005.955737:0:1509:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x0:0x0:0x0]) in obj [0x200000401:0x21:0x0], intent: open flags 0504001 00010000:00010000:3.0:1747400005.955776:0:1509:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.955782:0:1509:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747400005.955793:0:1509:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747400005.955798:0:1509:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62140 x1832281081734720/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747400005.955804:0:1509:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400005.955821:0:1509:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081734720:192.168.204.160@tcp:101:lfs.0 00000100:00100000:3.0:1747400005.955926:0:1509:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.958024:0:1509:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081734720:192.168.204.160@tcp:101:lfs.0 00010000:00010000:3.0:1747400005.958039:0:1509:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958047:0:1509:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958051:0:1509:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958057:0:1509:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958061:0:1509:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958064:0:1509:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b20b40 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747400005.958067:0:1509:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958071:0:1509:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958074:0:1509:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958077:0:1509:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747400005.958079:0:1509:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.958092:0:1509:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b20b40/0xd95e55596abdf2e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1509 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747400005.958108:0:1509:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012bf62140 x1832281081734720/t4294967410(4294967410) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747400005.958117:0:1509:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf62140 x1832281081734720/t4294967410(4294967410) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747400005.958145:0:1509:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:3.0:1747400005.958148:0:1509:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x22:0x0](ffff880136f93718): rc = 0 00000080:00010000:3.0:1747400005.958152:0:1509:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x22:0x0](ffff880136f93718) for lock 0x0 00000080:00200000:3.0:1747400005.958169:0:1509:0:(file.c:838:ll_file_open()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), flags 504000 00000002:00100000:3.0:1747400005.958182:0:1509:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012bf62140 x1832281081734720/t4294967410(4294967410) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:3.0:1747400005.958201:0:1509:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf62140 x1832281081734720/t4294967410(4294967410) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:3.0:1747400005.958223:0:1509:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747400005.958227:0:1509:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf61c80 x1832281081734848/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747400005.958243:0:1509:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf61c80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081734848:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747400005.958302:0:1509:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747400005.959942:0:1509:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf61c80 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081734848:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747400005.959962:0:1509:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf62140 x1832281081734720/t4294967410(4294967410) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1747400005.960056:0:1509:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), inode mode 41ed mask 44 00000080:00200000:3.0:1747400005.960096:0:1509:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718) 00000080:00200000:3.0:1747400005.960158:0:1509:0:(dir.c:1423:ll_dir_ioctl()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), cmd=0x4008669b 00000100:00100000:3.0:1747400005.960194:0:1509:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081734912:192.168.204.160@tcp:33:lfs.0 00000100:00100000:3.0:1747400005.960248:0:1509:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.961900:0:1509:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081734912:192.168.204.160@tcp:33:lfs.0 00000080:00200000:3.0:1747400005.962167:0:1509:0:(file.c:411:ll_file_release()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718) 00000002:00100000:3.0:1747400005.962194:0:1509:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012bf62600 x1832281081734592/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000020:00100000:3.0:1747400005.962216:0:1509:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1747400005.962220:0:1509:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62140 x1832281081735040/t0(0) o35->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1747400005.962233:0:1509:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081735040:192.168.204.160@tcp:35:lfs.0 00000100:00100000:3.0:1747400005.962282:0:1509:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 6 seconds 00000100:00100000:3.0:1747400005.966125:0:1509:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job lfs:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1509:1832281081735040:192.168.204.160@tcp:35:lfs.0 00000002:00100000:3.0:1747400005.966156:0:1509:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012bf62600 x1832281081734592/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 648/600 e 0 to 0 dl 1747400049 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'lfs.0' 00000080:00200000:3.0:1747400005.971001:0:1510:0:(file.c:5228:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8),name=/ 00000002:00010000:3.0:1747400005.971022:0:1510:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.971037:0:1510:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.971048:0:1510:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1747400005.971055:0:1510:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) 00000080:00010000:3.0:1747400005.971056:0:1510:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f900d8) for lock 0xd95e55596abdebc7 00000080:00010000:3.0:1747400005.971065:0:1510:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdebc7 from it ffff88012d673bb0 00010000:00010000:3.0:1747400005.971068:0:1510:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.971072:0:1510:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff88012b4598c0/0xd95e55596abdebc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6043a1 expref: -99 pid: 16940 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.971083:0:1510:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f900d8), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.971088:0:1510:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d15.ost-pools, flags=17 00000080:00200000:3.0:1747400005.971090:0:1510:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x21:0x0](ffff880136f92f58), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.971094:0:1510:0:(namei.c:1110:ll_lookup_nd()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), flags=17 00000080:00200000:3.0:1747400005.971098:0:1510:0:(namei.c:833:ll_lookup_it()) VFS Op:name=dir0, dir=[0x200000401:0x21:0x0](ffff880136f92f58), intent=0 00000002:00010000:3.0:1747400005.971103:0:1510:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: dir0,[0x0:0x0:0x0]) in obj [0x200000401:0x21:0x0], intent: lookup flags 0 00010000:00010000:3.0:1747400005.971140:0:1510:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.971144:0:1510:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.971150:0:1510:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400005.971170:0:1510:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1510:1832281081735104:192.168.204.160@tcp:101:createmany.0 00000100:00100000:3.0:1747400005.971258:0:1510:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00000100:00100000:3.0:1747400005.973088:0:1510:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1510:1832281081735104:192.168.204.160@tcp:101:createmany.0 00010000:00010000:3.0:1747400005.973108:0:1510:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 4/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973123:0:1510:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973137:0:1510:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973147:0:1510:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973156:0:1510:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973164:0:1510:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973168:0:1510:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973171:0:1510:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747400005.973176:0:1510:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff88012bf62140 x1832281081735104/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 576/640 e 0 to 0 dl 1747400049 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'createmany.0' 00000002:00010000:3.0:1747400005.973183:0:1510:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973188:0:1510:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e2db000 type 13 mode 4 res 8589935617/34 (0 0) 00000080:00200000:3.0:1747400005.973207:0:1510:0:(llite_lib.c:2763:ll_update_inode()) inode=[0x200000401:0x22:0x0], updating i_size 512 00000080:00200000:3.0:1747400005.973209:0:1510:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x22:0x0](ffff880136f93718): rc = 0 00000080:00010000:3.0:1747400005.973214:0:1510:0:(llite_internal.h:1744:ll_set_lock_data()) setting l_data to inode [0x200000401:0x22:0x0](ffff880136f93718) for lock 0xd95e55596abdf2ea 00000080:00010000:3.0:1747400005.973222:0:1510:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x22:0x0](ffff880136f93718) 00000080:00010000:3.0:1747400005.973227:0:1510:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xd95e55596abdf2ea from it ffff88012d673b20 00010000:00010000:3.0:1747400005.973228:0:1510:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973232:0:1510:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21440/0xd95e55596abdf2ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xb255fa25cf6076ae expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1747400005.973258:0:1510:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), inode mode 41ed mask 1 00000080:00200000:3.0:1747400005.973271:0:1510:0:(file.c:5662:ll_inode_permission()) VFS Op:inode=[0x200000401:0x22:0x0](ffff880136f93718), inode mode 41ed mask 3 00000080:00200000:3.0:1747400005.973274:0:1510:0:(namei.c:1185:ll_atomic_open()) VFS Op:name=f15.ost-pools0, dir=[0x200000401:0x22:0x0](ffff880136f93718), file ffff8800ae996d80, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1747400005.973280:0:1510:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f15.ost-pools0, dir=[0x200000401:0x22:0x0](ffff880136f93718), intent=open|creat 00000002:00010000:3.0:1747400005.973296:0:1510:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f15.ost-pools0,[0x200000401:0x24:0x0]) in obj [0x200000401:0x22:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1747400005.973363:0:1510:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400005.973369:0:1510:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1747400005.973378:0:1510:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b65c8800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1747400005.973382:0:1510:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012bf62140 x1832281081735232/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1747400005.973388:0:1510:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1747400005.973401:0:1510:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1510:1832281081735232:192.168.204.160@tcp:101:createmany.0 00000100:00100000:3.0:1747400005.973518:0:1510:0:(client.c:2500:ptlrpc_set_wait()) set ffff8800aeb5be40 going to sleep for 43 seconds 00010000:00010000:2.0:1747400006.118483:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400007.120107:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1747400008.124617:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1747400008.811928:0:32257:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400008.811933:0:32257:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747400008.811935:0:32257:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400008.811937:0:32257:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747400008.811972:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081735360:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1747400008.812048:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1747400008.812051:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081735296:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1747400008.814822:0:1863:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800b65c8800: committing for last_committed 4294967412 gen 1 00000100:00100000:1.0:1747400008.814858:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081735360:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1747400008.815212:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081735296:192.168.204.160@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1747400009.124303:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400010.125980:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1747400011.127494:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400012.129866:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400013.131695:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1747400013.819696:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400013.819701:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747400013.819712:0:305:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400013.819714:0:305:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747400013.819748:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081735488:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:0.0:1747400013.819809:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1747400013.819813:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081735424:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747400013.823114:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081735424:192.168.204.160@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1747400013.823128:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081735488:192.168.204.160@tcp:400:kworker/u8:3.0 00010000:00010000:2.0:1747400014.134958:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400015.135513:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400016.138193:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400017.139537:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400018.141560:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1747400018.828724:0:32257:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400018.828730:0:32257:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747400018.828732:0:32257:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400018.828734:0:32257:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747400018.828776:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081735616:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1747400018.828875:0:1862:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081735552:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1747400018.831204:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081735616:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1747400018.831288:0:1862:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b80d169-0905-4300-a34c-b155594364e5:1862:1832281081735552:192.168.204.160@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1747400019.144463:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400020.148228:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400021.149631:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400022.151857:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400023.154334:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1747400023.835570:0:32257:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400023.835575:0:32257:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00080000:0.0:1747400023.835576:0:32257:0:(pinger.c:251:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1747400023.835578:0:32257:0:(pinger.c:265:ptlrpc_pinger_process_import()) 7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1747400023.835601:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081735744:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1747400023.835665:0:1863:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1747400023.835670:0:1863:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013711c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081735680:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1747400023.840583:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b80d169-0905-4300-a34c-b155594364e5:1863:1832281081735680:192.168.204.160@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1747400023.840600:0:1863:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013711bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1863:1832281081735744:192.168.204.160@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1747400024.156510:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1747400025.158004:0:8848:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1747400025.976881:0:1510:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012bf62140 pname:cluuid:pid:xid:nid:opc:job createmany:7e3ec1ec-b23d-47f5-bdff-2788ec3fe9e7:1510:1832281081735232:192.168.204.160@tcp:101:createmany.0 00010000:00010000:3.0:1747400025.976906:0:1510:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976915:0:1510:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976920:0:1510:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976925:0:1510:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976930:0:1510:0:(ldlm_lockd.c:1880:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976935:0:1510:0:(ldlm_lockd.c:1894:ldlm_handle_bl_callback()) Lock ffff880136b21680 already unused, calling callback (ffffffffa0f9bc50) 00010000:00010000:3.0:1747400025.976937:0:1510:0:(ldlm_request.c:1549:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976942:0:1510:0:(ldlm_request.c:1559:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 4/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976978:0:1510:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 5/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976983:0:1510:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1747400025.976986:0:1510:0:(ldlm_lockd.c:1904:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1747400025.976990:0:1510:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b65c8800 lock: ffff880136b21680/0xd95e55596abdf2f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 1510 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1747400025.977026:0:1510:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=17, status=-28 req@ffff88012bf62140 x1832281081735232/t0(0) o101->lustre-MDT0000-mdc-ffff8800b65c8800@192.168.204.160@tcp:12/10 lens 656/600 e 0 to 0 dl 1747400049 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'createmany.0' 00000080:00200000:3.0:1747400025.977090:0:1510:0:(namei.c:1416:ll_create_it()) VFS Op:name=f15.ost-pools0, dir=[0x200000401:0x22:0x0](ffff880136f93718), intent=open|creat 00010000:00010000:2.0:1747400026.161693:0:4666:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1747400026.556238:0:1658:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1747400026.556241:0:1658:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: ost-pools test_15: @@@@@@ FAIL: createmany /mnt/lustre/d15.ost-pools/dir0/f15.ost-pools failed! 00010000:00010000:3.0:1747400027.168035:0:4665:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1154 lines, 1154 kept, 0 dropped, 0 bad.