00010000:00010000:1.0F:1715206666.498161:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715206667.219743:0:1946:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.138@tcp (source: 12345-192.168.202.138@tcp) 00000100:00100000:1.0:1715206667.219773:0:1946:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.138@tcp (source: 12345-192.168.202.138@tcp) 00000100:00100000:0.0F:1715206667.219802:0:8886:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508076288 00000100:00100000:1.0:1715206667.219817:0:1946:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.138@tcp (source: 12345-192.168.202.138@tcp) 00000100:00100000:0.0:1715206667.219818:0:8886:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508076288 00000100:00100000:1.0:1715206667.219838:0:4766:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508076352 00000100:00100000:1.0:1715206667.219842:0:4766:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508076352 00000100:00100000:0.0:1715206667.219844:0:8886:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508076416 00000100:00100000:0.0:1715206667.219846:0:8886:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508076416 00000100:00100000:0.0:1715206667.219858:0:8886:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.138@tcp, seq: 35 00000100:00100000:0.0:1715206667.219865:0:8886:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+5:18955:x1798523508076288:12345-192.168.202.138@tcp:104: 00000100:00100000:1.0:1715206667.219869:0:4766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.138@tcp, seq: 36 00000100:00100000:1.0:1715206667.219873:0:4766:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+5:18955:x1798523508076416:12345-192.168.202.138@tcp:104: 00010000:00010000:0.0:1715206667.219878:0:8886:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.138@tcp lock: ffff8800aa309680/0xbbeffb005ec3df2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f66395 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206667.219880:0:4766:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f66387 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206667.219928:0:4766:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1715206667.219932:0:4766:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+5:18955:x1798523508076416:12345-192.168.202.138@tcp:104: Request processed in 59us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1715206667.219933:0:8886:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1715206667.219938:0:4766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.138@tcp, seq: 36 00000100:00100000:0.0:1715206667.219940:0:8886:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+5:18955:x1798523508076288:12345-192.168.202.138@tcp:104: Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206667.219946:0:8886:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.138@tcp, seq: 35 00000100:00100000:1.0:1715206667.219950:0:4766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.138@tcp, seq: 37 00000100:00100000:1.0:1715206667.219952:0:4766:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+4:18955:x1798523508076352:12345-192.168.202.138@tcp:104: 00010000:00010000:2.0F:1715206667.219956:0:3699:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715206667.219957:0:4766:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.138@tcp lock: ffff8800aa309f80/0xbbeffb005ec3df24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f6638e expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206667.219966:0:3699:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f66387 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206667.219971:0:3699:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa30a1c0 already unused, calling callback (ffffffffa04dfa40) 10000000:00010000:2.0:1715206667.219974:0:3699:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c55e4ad37f66387 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206667.219979:0:4766:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1715206667.219980:0:3699:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c55e4ad37f66387 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715206667.219982:0:4766:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+3:18955:x1798523508076352:12345-192.168.202.138@tcp:104: Request processed in 29us (210us total) trans 0 rc 0/0 10000000:00010000:2.0:1715206667.219984:0:3699:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c55e4ad37f66387 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206667.219986:0:3699:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1715206667.219986:0:4766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.138@tcp, seq: 37 00010000:00010000:1.0:1715206667.219998:0:3697:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715206667.220001:0:3697:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.138@tcp lock: ffff8800aa309680/0xbbeffb005ec3df2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f66395 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206667.220005:0:3697:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa309680 already unused, calling callback (ffffffffa04dfa40) 00010000:00010000:2.0:1715206667.220011:0:3699:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f66387 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715206667.220012:0:3697:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.138@tcp lock: ffff8800aa309680/0xbbeffb005ec3df2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c55e4ad37f66395 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206667.220014:0:3699:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715206667.220018:0:3697:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.138@tcp lock: ffff8800aa309680/0xbbeffb005ec3df2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c55e4ad37f66395 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0F:1715206667.220020:0:4776:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1715206667.220023:0:3697:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.138@tcp lock: ffff8800aa309680/0xbbeffb005ec3df2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c55e4ad37f66395 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206667.220026:0:3699:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f66387 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715206667.220026:0:3697:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1715206667.220030:0:4776:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.138@tcp lock: ffff8800aa309f80/0xbbeffb005ec3df24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f6638e expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206667.220031:0:3699:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f66387 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206667.220037:0:4776:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa309f80 already unused, calling callback (ffffffffa04dfa40) 10000000:00010000:3.0:1715206667.220060:0:4776:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.138@tcp lock: ffff8800aa309f80/0xbbeffb005ec3df24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c55e4ad37f6638e expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206667.220063:0:3697:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.138@tcp lock: ffff8800aa309680/0xbbeffb005ec3df2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f66395 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206667.220067:0:4776:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.138@tcp lock: ffff8800aa309f80/0xbbeffb005ec3df24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c55e4ad37f6638e expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206667.220068:0:3697:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1715206667.220072:0:4776:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.138@tcp lock: ffff8800aa309f80/0xbbeffb005ec3df24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c55e4ad37f6638e expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206667.220073:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206667.220075:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1715206667.220076:0:4776:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1715206667.220076:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206667.220082:0:3697:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.138@tcp lock: ffff8800aa309680/0xbbeffb005ec3df2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f66395 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206667.220083:0:1956:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1715206667.220088:0:3697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.138@tcp lock: ffff8800aa309680/0xbbeffb005ec3df2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f66395 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715206667.220091:0:1955:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1955:1798523503853248:192.168.202.138@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206667.220093:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503853184:192.168.202.138@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715206667.220095:0:4776:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.138@tcp lock: ffff8800aa309f80/0xbbeffb005ec3df24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f6638e expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206667.220099:0:4776:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715206667.220102:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206667.220103:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206667.220105:0:4776:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.138@tcp lock: ffff8800aa309f80/0xbbeffb005ec3df24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f6638e expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206667.220105:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206667.220111:0:4776:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.138@tcp lock: ffff8800aa309f80/0xbbeffb005ec3df24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f6638e expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206667.220125:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206667.220127:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206667.220129:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715206667.220131:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503853312:192.168.202.138@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206667.220794:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503853312:192.168.202.138@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715206667.220805:0:1955:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1955:1798523503853248:192.168.202.138@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206667.220807:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503853184:192.168.202.138@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715206667.500251:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1715206667.788188:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206667.788194:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206667.788196:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206667.788199:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206667.788227:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206667.788229:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715206667.788230:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503853376:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715206667.788252:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503853440:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206667.788305:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503853504:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206667.789411:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503853376:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206667.789427:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503853504:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715206667.789429:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503853440:192.168.202.138@tcp:400:kworker.0 00010000:00010000:0.0:1715206668.502224:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1715206668.539151:0:4778:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1715206668.539163:0:4778:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800aa1c9800 from 49 10000000:01000000:0.0:1715206668.539168:0:4778:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1715206668.539204:0:4778:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206668.539214:0:4778:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206668.539225:0:4778:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715206668.539246:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012aaf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853568:192.168.202.138@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1715206668.539314:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aaeee480 going to sleep for 11 seconds 00000100:00100000:2.0:1715206668.540567:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853568:192.168.202.138@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206668.540584:0:4778:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.540594:0:4778:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206668.540639:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853632:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.540674:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206668.541524:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853632:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.541553:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853696:192.168.202.138@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.541601:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206668.542669:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853696:192.168.202.138@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206668.542906:0:4325:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4325:1798523503853760:192.168.202.138@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206668.542952:0:4325:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801303433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206668.544204:0:4325:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4325:1798523503853760:192.168.202.138@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206668.544228:0:4325:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206668.544235:0:4325:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206668.544237:0:4325:0:(obd_config.c:1497:class_process_config()) marker 32 (0x1) lustre-clilov rem lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:3.0:1715206668.544242:0:4325:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800aa1c9800 00000020:00000080:3.0:1715206668.544244:0:4325:0:(obd_config.c:1409:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1715206668.544256:0:4325:0:(lov_pool.c:634:lov_pool_remove()) lustre-OST0001_UUID removed from test_11c 00000100:00100000:3.0:1715206668.544273:0:4325:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4325:1798523503853824:192.168.202.138@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206668.544317:0:4325:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801303433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206668.545120:0:4325:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4325:1798523503853824:192.168.202.138@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206668.545138:0:4325:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206668.545141:0:4325:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206668.545143:0:4325:0:(obd_config.c:1497:class_process_config()) marker 32 (0x2) lustre-clilov rem lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1715206668.545146:0:4325:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1715206668.545195:0:4778:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:2.0:1715206668.545213:0:4778:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.202.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206668.545224:0:4778:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.545239:0:4778:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206668.545247:0:4778:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206668.545250:0:4778:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800b0712000 from 49 10000000:01000000:2.0:1715206668.545252:0:4778:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206668.545270:0:4778:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.545276:0:4778:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.545284:0:4778:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206668.545295:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853888:192.168.202.138@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.545329:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206668.545982:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853888:192.168.202.138@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206668.545996:0:4778:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.546004:0:4778:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206668.546033:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853952:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.546087:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206668.546773:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503853952:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.546801:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854016:192.168.202.138@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.546829:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206668.547554:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854016:192.168.202.138@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206668.547760:0:4326:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4326:1798523503854080:192.168.202.138@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206668.547798:0:4326:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801303433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206668.548563:0:4326:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4326:1798523503854080:192.168.202.138@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206668.548590:0:4326:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206668.548597:0:4326:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206668.548599:0:4326:0:(obd_config.c:1497:class_process_config()) marker 32 (0x1) lustre-clilov rem lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:3.0:1715206668.548604:0:4326:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b0712000 00000020:00000080:3.0:1715206668.548607:0:4326:0:(obd_config.c:1409:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1715206668.548615:0:4326:0:(lov_pool.c:634:lov_pool_remove()) lustre-OST0001_UUID removed from test_11c 00000100:00100000:3.0:1715206668.548631:0:4326:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4326:1798523503854144:192.168.202.138@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206668.548672:0:4326:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801303433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206668.549534:0:4326:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4326:1798523503854144:192.168.202.138@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206668.549549:0:4326:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206668.549552:0:4326:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206668.549553:0:4326:0:(obd_config.c:1497:class_process_config()) marker 32 (0x2) lustre-clilov rem lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1715206668.549555:0:4326:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1715206668.549597:0:4778:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:2.0:1715206668.549610:0:4778:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.202.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206668.549615:0:4778:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.549623:0:4778:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206668.549631:0:4778:0:(mgc_request.c:626:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1715206668.549633:0:4778:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-sptlrpc-ffff88012a670000 from 1 10000000:01000000:2.0:1715206668.549635:0:4778:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1715206668.549652:0:4778:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.549658:0:4778:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.549665:0:4778:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206668.549676:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854208:192.168.202.138@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.549703:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206668.550627:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854208:192.168.202.138@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206668.550639:0:4778:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.550653:0:4778:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206668.550691:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854272:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206668.550725:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206668.551347:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854272:192.168.202.138@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1715206668.551363:0:4778:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.202.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1715206668.551368:0:4778:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206668.551375:0:4778:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206669.504154:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715206669.677711:0:1946:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.138@tcp (source: 12345-192.168.202.138@tcp) 00000100:00100000:0.0:1715206669.677762:0:1946:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.138@tcp (source: 12345-192.168.202.138@tcp) 00000100:00100000:0.0:1715206669.677793:0:1946:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.138@tcp (source: 12345-192.168.202.138@tcp) 00000100:00100000:0.0:1715206669.677819:0:8886:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508080384 00000100:00100000:0.0:1715206669.677828:0:8886:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508080384 00000100:00100000:1.0:1715206669.677845:0:4765:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508080640 00000100:00100000:1.0:1715206669.677850:0:4765:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508080640 00000100:00100000:0.0:1715206669.677854:0:8886:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508080704 00000100:00100000:0.0:1715206669.677856:0:8886:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508080704 00000100:00100000:0.0:1715206669.677868:0:8886:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.138@tcp, seq: 38 00000100:00100000:0.0:1715206669.677875:0:8886:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012aaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+5:19121:x1798523508080384:12345-192.168.202.138@tcp:104: 00000100:00100000:1.0:1715206669.677876:0:4765:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.138@tcp, seq: 39 00000100:00100000:1.0:1715206669.677881:0:4765:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012aaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+5:19121:x1798523508080640:12345-192.168.202.138@tcp:104: 00010000:00010000:1.0:1715206669.677889:0:4765:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.677889:0:8886:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206669.677950:0:4765:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1715206669.677956:0:4765:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012aaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+5:19121:x1798523508080640:12345-192.168.202.138@tcp:104: Request processed in 74us (193us total) trans 0 rc 0/0 00010000:00010000:0.0:1715206669.677961:0:8886:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1715206669.677963:0:4765:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.138@tcp, seq: 39 00000100:00100000:0.0:1715206669.677967:0:8886:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012aaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+5:19121:x1798523508080384:12345-192.168.202.138@tcp:104: Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206669.677974:0:8886:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.138@tcp, seq: 38 00000100:00100000:1.0:1715206669.677978:0:4765:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.138@tcp, seq: 40 00000100:00100000:1.0:1715206669.677982:0:4765:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012aaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+3:19121:x1798523508080704:12345-192.168.202.138@tcp:104: 00010000:00010000:1.0:1715206669.677989:0:4765:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.677991:0:4776:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715206669.677998:0:4776:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.678006:0:4776:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa30a1c0 already unused, calling callback (ffffffffa04dfa40) 10000000:00010000:3.0:1715206669.678010:0:4776:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206669.678012:0:4765:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1715206669.678016:0:4765:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012aaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+3:19121:x1798523508080704:12345-192.168.202.138@tcp:104: Request processed in 33us (223us total) trans 0 rc 0/0 00010000:00010000:3.0:1715206669.678017:0:4776:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715206669.678021:0:4765:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.138@tcp, seq: 40 10000000:00010000:3.0:1715206669.678022:0:4776:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715206669.678026:0:4776:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1715206669.678036:0:3698:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715206669.678073:0:3698:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206669.678080:0:3698:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa30a400 already unused, calling callback (ffffffffa04dfa40) 00010000:00010000:0.0:1715206669.678081:0:3699:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1715206669.678083:0:3698:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.678085:0:4776:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.678086:0:3699:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206669.678089:0:3698:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.678093:0:3699:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac2bf3c0 already unused, calling callback (ffffffffa04dfa40) 10000000:00010000:1.0:1715206669.678094:0:3698:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1715206669.678096:0:3699:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.678097:0:4776:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1715206669.678098:0:3698:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1715206669.678102:0:3699:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1715206669.678108:0:3699:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715206669.678112:0:3699:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1715206669.678128:0:4776:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206669.678128:0:3698:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206669.678133:0:3698:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715206669.678133:0:3699:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.678134:0:4776:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.138@tcp lock: ffff8800aa30a1c0/0xbbeffb005ec3df5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663aa expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.678138:0:3699:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715206669.678144:0:3698:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206669.678146:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503854336:192.168.202.138@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715206669.678146:0:3699:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.678148:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206669.678150:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206669.678150:0:3698:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.138@tcp lock: ffff8800aa30a400/0xbbeffb005ec3df63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663b1 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.678152:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206669.678152:0:3699:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.138@tcp lock: ffff8800ac2bf3c0/0xbbeffb005ec3df55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8c55e4ad37f663a3 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206669.678163:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206669.678164:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206669.678166:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206669.678168:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206669.678169:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206669.678171:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715206669.678175:0:1954:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1954:1798523503854400:192.168.202.138@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1715206669.678190:0:1955:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012aaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1955:1798523503854464:192.168.202.138@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715206669.678917:0:1954:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1954:1798523503854400:192.168.202.138@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1715206669.678931:0:1955:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1955:1798523503854464:192.168.202.138@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206669.678962:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503854336:192.168.202.138@tcp:103:ldlm_bl.0 10000000:01000000:2.0:1715206670.478142:0:4778:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206670.478147:0:4778:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800aa1c9800 from 52 10000000:01000000:2.0:1715206670.478150:0:4778:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206670.478185:0:4778:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30a640/0xbbeffb005ec3df6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.478194:0:4778:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.138@tcp lock: ffff8800aa30a640/0xbbeffb005ec3df6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.478203:0:4778:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.138@tcp lock: ffff8800aa30a640/0xbbeffb005ec3df6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.478241:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854528:192.168.202.138@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.478305:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.479494:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854528:192.168.202.138@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206670.479511:0:4778:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.138@tcp lock: ffff8800aa30a640/0xbbeffb005ec3df6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f66483 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.479522:0:4778:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.138@tcp lock: ffff8800aa30a640/0xbbeffb005ec3df6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c55e4ad37f66483 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.479568:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854592:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.479603:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.480349:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854592:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.480373:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854656:192.168.202.138@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.480413:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.481190:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854656:192.168.202.138@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206670.481416:0:4345:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4345:1798523503854720:192.168.202.138@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206670.481453:0:4345:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801303430c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206670.482340:0:4345:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4345:1798523503854720:192.168.202.138@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206670.482358:0:4345:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206670.482364:0:4345:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206670.482365:0:4345:0:(obd_config.c:1497:class_process_config()) marker 34 (0x1) lustre-clilov del lustre.test_11c 00000020:01000000:3.0:1715206670.482368:0:4345:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800aa1c9800 00000020:00000080:3.0:1715206670.482370:0:4345:0:(obd_config.c:1409:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1715206670.482431:0:4345:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4345:1798523503854784:192.168.202.138@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206670.482460:0:4345:0:(client.c:2542:ptlrpc_set_wait()) set ffff880130343600 going to sleep for 11 seconds 00000100:00100000:3.0:1715206670.483144:0:4345:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4345:1798523503854784:192.168.202.138@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206670.483161:0:4345:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206670.483164:0:4345:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206670.483165:0:4345:0:(obd_config.c:1497:class_process_config()) marker 34 (0x2) lustre-clilov del lustre.test_11c 00000040:00080000:3.0:1715206670.483167:0:4345:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1715206670.483229:0:4778:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1715206670.483245:0:4778:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.202.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206670.483252:0:4778:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30a640/0xbbeffb005ec3df6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f66483 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.483262:0:4778:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.138@tcp lock: ffff8800aa30a640/0xbbeffb005ec3df6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f66483 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206670.483271:0:4778:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206670.483278:0:4778:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800b0712000 from 52 10000000:01000000:2.0:1715206670.483281:0:4778:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206670.483298:0:4778:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30a880/0xbbeffb005ec3df71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.483305:0:4778:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.138@tcp lock: ffff8800aa30a880/0xbbeffb005ec3df71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.483312:0:4778:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.138@tcp lock: ffff8800aa30a880/0xbbeffb005ec3df71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.483324:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854848:192.168.202.138@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.483361:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.483991:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854848:192.168.202.138@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206670.484001:0:4778:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.138@tcp lock: ffff8800aa30a880/0xbbeffb005ec3df71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f6648a expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.484008:0:4778:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.138@tcp lock: ffff8800aa30a880/0xbbeffb005ec3df71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c55e4ad37f6648a expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.484032:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854912:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.484074:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.484651:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854912:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.484669:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854976:192.168.202.138@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.484710:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.485399:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503854976:192.168.202.138@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206670.485556:0:4346:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4346:1798523503855040:192.168.202.138@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206670.485592:0:4346:0:(client.c:2542:ptlrpc_set_wait()) set ffff880130343600 going to sleep for 11 seconds 00000100:00100000:3.0:1715206670.486384:0:4346:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4346:1798523503855040:192.168.202.138@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206670.486407:0:4346:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206670.486412:0:4346:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206670.486414:0:4346:0:(obd_config.c:1497:class_process_config()) marker 34 (0x1) lustre-clilov del lustre.test_11c 00000020:01000000:3.0:1715206670.486419:0:4346:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b0712000 00000020:00000080:3.0:1715206670.486421:0:4346:0:(obd_config.c:1409:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1715206670.486486:0:4346:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4346:1798523503855104:192.168.202.138@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206670.486525:0:4346:0:(client.c:2542:ptlrpc_set_wait()) set ffff880130343b40 going to sleep for 11 seconds 00000100:00100000:3.0:1715206670.487262:0:4346:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4346:1798523503855104:192.168.202.138@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206670.487280:0:4346:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206670.487283:0:4346:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206670.487285:0:4346:0:(obd_config.c:1497:class_process_config()) marker 34 (0x2) lustre-clilov del lustre.test_11c 00000040:00080000:3.0:1715206670.487288:0:4346:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1715206670.487338:0:4778:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1715206670.487356:0:4778:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.202.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206670.487362:0:4778:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30a880/0xbbeffb005ec3df71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f6648a expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.487370:0:4778:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.138@tcp lock: ffff8800aa30a880/0xbbeffb005ec3df71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f6648a expref: -99 pid: 4778 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206670.487378:0:4778:0:(mgc_request.c:626:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1715206670.487380:0:4778:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-sptlrpc-ffff88012a670000 from 1 10000000:01000000:2.0:1715206670.487382:0:4778:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1715206670.487397:0:4778:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30aac0/0xbbeffb005ec3df78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.487404:0:4778:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.138@tcp lock: ffff8800aa30aac0/0xbbeffb005ec3df78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.487411:0:4778:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.138@tcp lock: ffff8800aa30aac0/0xbbeffb005ec3df78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.487424:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503855168:192.168.202.138@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.487465:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.488121:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503855168:192.168.202.138@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206670.488133:0:4778:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.138@tcp lock: ffff8800aa30aac0/0xbbeffb005ec3df78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f66491 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.488141:0:4778:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.138@tcp lock: ffff8800aa30aac0/0xbbeffb005ec3df78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8c55e4ad37f66491 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.488172:0:4778:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503855232:192.168.202.138@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.488207:0:4778:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.488800:0:4778:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:4778:1798523503855232:192.168.202.138@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1715206670.488816:0:4778:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.202.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1715206670.488821:0:4778:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.138@tcp lock: ffff8800aa30aac0/0xbbeffb005ec3df78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f66491 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.488828:0:4778:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.138@tcp lock: ffff8800aa30aac0/0xbbeffb005ec3df78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8c55e4ad37f66491 expref: -99 pid: 4778 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206670.506273:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206671.508113:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206672.510224:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1715206672.796108:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206672.796113:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206672.796114:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206672.796116:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206672.796127:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206672.796128:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715206672.796138:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503855296:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206672.796200:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503855424:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206672.796213:0:1957:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715206672.796217:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503855360:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206672.796988:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503855360:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206672.796994:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503855424:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206672.796998:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503855296:192.168.202.138@tcp:400:kworker.0 00010000:00010000:0.0:1715206673.512173:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206674.364662:0:4740:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 18:17:54 (1715206674) 00000080:00200008:3.0:1715206674.426212:0:4797:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206674.426218:0:4797:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206674.426231:0:4797:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206674.426243:0:4797:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206674.426256:0:4797:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206674.426263:0:4797:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206674.426265:0:4797:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206674.426270:0:4797:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88012e1b3cc8 00010000:00010000:3.0:1715206674.426273:0:4797:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206674.426278:0:4797:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715206674.426554:0:4797:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206674.426557:0:4797:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715206674.426565:0:4797:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206674.426596:0:4797:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426600:0:4797:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426606:0:4797:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4797 initiator: MDT0 00000100:00100000:3.0:1715206674.426616:0:4797:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ac1dac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715206674.426624:0:4797:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:4797:1798523503855488:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715206674.426629:0:4797:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426639:0:4797:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426642:0:4797:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426645:0:4797:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426648:0:4797:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426652:0:4797:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae74d80 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715206674.426654:0:4797:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426658:0:4797:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426661:0:4797:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426664:0:4797:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206674.426668:0:4797:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4797 initiator: MDT0 00010000:00010000:3.0:1715206674.426671:0:4797:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3df7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4797 initiator: MDT0 00000080:00020000:3.0:1715206674.426683:0:4797:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715206674.426692:0:4797:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206674.426695:0:4797:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206674.426701:0:4797:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206674.426704:0:4797:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206674.426709:0:4797:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206674.426714:0:4797:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206674.426715:0:4797:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206674.426717:0:4797:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88012e1b3cc8 00010000:00010000:3.0:1715206674.426719:0:4797:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206674.426722:0:4797:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206674.426766:0:4797:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206674.426771:0:4797:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206674.426774:0:4797:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206674.426779:0:4797:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206674.426783:0:4797:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206674.426784:0:4797:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206674.426786:0:4797:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88012e1b3b80 00010000:00010000:3.0:1715206674.426788:0:4797:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206674.426797:0:4797:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206674.426802:0:4797:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715206674.426806:0:4797:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715206674.427291:0:4798:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715206674.427301:0:4798:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206674.427308:0:4798:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206674.427317:0:4798:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206674.427324:0:4798:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715206674.427326:0:4798:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:1.0:1715206674.427330:0:4798:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff8800a9487b80 00010000:00010000:1.0:1715206674.427336:0:4798:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206674.427342:0:4798:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206674.427350:0:4798:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715206674.427354:0:4798:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715206674.427375:0:4798:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715206674.427380:0:4798:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206674.427384:0:4798:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206674.427388:0:4798:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206674.427393:0:4798:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715206674.427394:0:4798:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:1.0:1715206674.427396:0:4798:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff8800a9487bb0 00010000:00010000:1.0:1715206674.427397:0:4798:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206674.427401:0:4798:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206674.427406:0:4798:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715206674.427409:0:4798:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:1.0:1715206674.427411:0:4798:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff88012e4b90c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715206674.427416:0:4798:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), file ffff8800b47c6d80, open_flags 8000, mode 0 opened 0 00000080:00200000:1.0:1715206674.427424:0:4798:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), intent=open 00000002:00010000:1.0:1715206674.427431:0:4798:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:1.0:1715206674.427469:0:4798:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 4798 initiator: MDT0 00010000:00010000:1.0:1715206674.427475:0:4798:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 4798 initiator: MDT0 00000020:00100000:1.0:1715206674.427483:0:4798:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1715206674.427490:0:4798:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012a616300 x1798523503855616/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1715206674.427498:0:4798:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 4798 initiator: MDT0 00000100:00100000:1.0:1715206674.427509:0:4798:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a616300 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:4798:1798523503855616:192.168.202.138@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1715206674.427611:0:4798:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa2c5b40 going to sleep for 145 seconds 00000100:00100000:2.0:1715206674.428922:0:4798:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a616300 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:4798:1798523503855616:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715206674.428930:0:4798:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428936:0:4798:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428939:0:4798:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428949:0:4798:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428952:0:4798:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428955:0:4798:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bae880 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206674.428956:0:4798:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428959:0:4798:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428962:0:4798:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428965:0:4798:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206674.428967:0:4798:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 4798 initiator: MDT0 00010000:00010000:2.0:1715206674.428970:0:4798:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3df86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 4798 initiator: MDT0 00000002:00100000:2.0:1715206674.428978:0:4798:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012a616300 x1798523503855616/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206824 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:2.0:1715206674.428986:0:4798:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a616300 x1798523503855616/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206824 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715206674.429001:0:4798:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 10752 00000080:00200000:2.0:1715206674.429003:0:4798:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b08900c8): rc = 0 00000080:00010000:2.0:1715206674.429006:0:4798:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b08900c8) for lock 0x0 00000080:00200008:2.0:1715206674.429014:0:4798:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715206674.429024:0:4798:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a616300 x1798523503855616/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206824 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715206674.429071:0:4798:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b08900c8), inode mode 4040 mask 44 00000080:00200080:2.0:1715206674.429106:0:4798:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=1e0d0f0 00800000:00000080:2.0:1715206674.429113:0:4798:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800adc73520 uarg=0000000000000000 00000002:00000080:2.0:1715206674.429119:0:4798:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800adc73520 uarg=0000000000000000 00000100:00100000:2.0:1715206674.429134:0:4798:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:4798:1798523503855680:192.168.202.138@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715206674.429157:0:4798:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391300 going to sleep for 145 seconds 00000100:00100000:2.0:1715206674.429798:0:4798:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:4798:1798523503855680:192.168.202.138@tcp:59:lhsmtool_posix.0 00000080:00200000:3.0:1715206674.432715:0:4799:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715206674.432726:0:4799:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206674.432749:0:4799:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432754:0:4799:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432759:0:4799:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00000100:00100000:3.0:1715206674.432766:0:4799:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ac1dac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715206674.432770:0:4799:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:4799:1798523503855744:192.168.202.138@tcp:101:lfs.0 00010000:00010000:3.0:1715206674.432775:0:4799:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432778:0:4799:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432781:0:4799:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432785:0:4799:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432788:0:4799:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432794:0:4799:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae75200 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715206674.432796:0:4799:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432799:0:4799:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432803:0:4799:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432806:0:4799:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206674.432808:0:4799:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432811:0:4799:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75200/0xbbeffb005ec3df8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4799 initiator: MDT0 00000080:00020000:3.0:1715206674.432821:0:4799:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715206674.432834:0:4799:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715206674.432838:0:4799:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206674.432848:0:4799:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432851:0:4799:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432854:0:4799:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00000100:00100000:3.0:1715206674.432859:0:4799:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ac1dac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715206674.432862:0:4799:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:4799:1798523503855808:192.168.202.138@tcp:101:lfs.0 00010000:00010000:3.0:1715206674.432865:0:4799:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432871:0:4799:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432874:0:4799:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432877:0:4799:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432880:0:4799:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432882:0:4799:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae75b00 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715206674.432884:0:4799:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432886:0:4799:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432889:0:4799:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432892:0:4799:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206674.432893:0:4799:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432896:0:4799:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3df94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4799 initiator: MDT0 00000080:00020000:3.0:1715206674.432904:0:4799:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715206674.432913:0:4799:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206674.432915:0:4799:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715206674.432921:0:4799:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206674.432930:0:4799:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432934:0:4799:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432937:0:4799:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00000100:00100000:3.0:1715206674.432941:0:4799:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ac1dac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715206674.432944:0:4799:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:4799:1798523503855872:192.168.202.138@tcp:101:lfs.0 00010000:00010000:3.0:1715206674.432947:0:4799:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432950:0:4799:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432953:0:4799:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432955:0:4799:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432958:0:4799:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432961:0:4799:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae74240 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715206674.432962:0:4799:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432965:0:4799:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432972:0:4799:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432975:0:4799:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206674.432976:0:4799:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4799 initiator: MDT0 00010000:00010000:3.0:1715206674.432979:0:4799:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74240/0xbbeffb005ec3df9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4799 initiator: MDT0 00000080:00020000:3.0:1715206674.432986:0:4799:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715206674.503729:0:4836:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715206674.503745:0:4836:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206674.503784:0:4836:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503790:0:4836:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503796:0:4836:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4836 initiator: MDT0 00000100:00100000:3.0:1715206674.503808:0:4836:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ac1dac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715206674.503815:0:4836:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job mkdir:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:4836:1798523503855936:192.168.202.138@tcp:101:mkdir.0 00010000:00010000:3.0:1715206674.503821:0:4836:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503825:0:4836:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503829:0:4836:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503836:0:4836:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503840:0:4836:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503843:0:4836:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae76400 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715206674.503846:0:4836:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503849:0:4836:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503853:0:4836:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503856:0:4836:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206674.503860:0:4836:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4836 initiator: MDT0 00010000:00010000:3.0:1715206674.503863:0:4836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76400/0xbbeffb005ec3dfa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4836 initiator: MDT0 00000080:00020000:3.0:1715206674.503877:0:4836:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:1.0:1715206674.514118:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715206674.822452:0:4969:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12a: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d12a.sanity-hsm' Debug log: 560 lines, 560 kept, 0 dropped, 0 bad.