00010000:00010000:3.0F:1715206669.056684:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1715206669.241622:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206669.241689:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206669.241718:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:1.0F:1715206669.241735:0:5352:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715206669.241758:0:12808:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1715206669.241769:0:12808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510331648 00000100:00100000:1.0:1715206669.241770:0:5352:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510331712 00000100:00100000:1.0:1715206669.241778:0:5352:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510331712 00000100:00100000:0.0:1715206669.241778:0:12808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510331648 00000100:00100000:1.0:1715206669.241821:0:5352:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 40 00000100:00100000:1.0:1715206669.241829:0:5352:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+4:11953:x1798523510331712:12345-192.168.201.123@tcp:104: 00000100:00100000:0.0:1715206669.241829:0:12808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 41 00000100:00100000:0.0:1715206669.241836:0:12808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+4:11953:x1798523510331648:12345-192.168.201.123@tcp:104: 00000100:00100000:2.0F:1715206669.241839:0:5354:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510331776 00010000:00010000:1.0:1715206669.241840:0:5352:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.241850:0:12808:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206669.241854:0:5354:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510331776 00010000:00010000:1.0:1715206669.241890:0:5352:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715206669.241895:0:5352:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:11953:x1798523510331712:12345-192.168.201.123@tcp:104: Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206669.241899:0:5354:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 0 00000100:00100000:1.0:1715206669.241900:0:5352:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 40 00010000:00010000:0.0:1715206669.241902:0:12808:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1715206669.241905:0:5354:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:11953:x1798523510331776:12345-192.168.201.123@tcp:104: 00000100:00100000:0.0:1715206669.241908:0:12808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:11953:x1798523510331648:12345-192.168.201.123@tcp:104: Request processed in 72us (300us total) trans 0 rc 0/0 00010000:00010000:2.0:1715206669.241915:0:5354:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715206669.241915:0:12808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 41 00010000:00010000:3.0:1715206669.241950:0:5362:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715206669.241959:0:5362:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206669.241964:0:5354:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1715206669.241967:0:2527:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715206669.241968:0:5362:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9239f80 already unused, calling callback (ffffffffa0af8a40) 00000100:00100000:2.0:1715206669.241970:0:5354:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+3:11953:x1798523510331776:12345-192.168.201.123@tcp:104: Request processed in 64us (251us total) trans 0 rc 0/0 10000000:00010000:3.0:1715206669.241972:0:5362:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.241973:0:2527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206669.241976:0:5354:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 0 00010000:00010000:0.0:1715206669.241980:0:2527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a923a1c0 already unused, calling callback (ffffffffa0af8a40) 00010000:00010000:3.0:1715206669.241981:0:5362:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1715206669.241984:0:2527:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1715206669.241987:0:5362:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.241991:0:2527:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715206669.241992:0:5362:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1715206669.241996:0:2527:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715206669.242002:0:2527:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1715206669.242017:0:2469:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715206669.242022:0:2469:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206669.242029:0:2469:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa5873c0 already unused, calling callback (ffffffffa0af8a40) 10000000:00010000:2.0:1715206669.242032:0:2469:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.242033:0:5362:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206669.242038:0:2469:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.242039:0:5362:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715206669.242039:0:2527:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1715206669.242044:0:2469:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206669.242048:0:2469:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1715206669.242054:0:2527:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715206669.242055:0:5362:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.242061:0:5362:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206669.242076:0:2469:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206669.242078:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206669.242079:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206669.242081:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206669.242081:0:2469:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715206669.242083:0:2527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715206669.242085:0:2000:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1715206669.242090:0:2469:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.242092:0:2527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715206669.242093:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523504928128:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715206669.242094:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504928192:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715206669.242106:0:2469:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206669.242116:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206669.242118:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206669.242122:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715206669.242125:0:2002:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1715206669.242127:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206669.242129:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715206669.242131:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523504928256:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715206669.242131:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715206669.243058:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504928192:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715206669.243091:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523504928256:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715206669.243099:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523504928128:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715206670.058846:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1715206670.266694:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1715206670.266702:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800a9618000 from 58 10000000:01000000:1.0:1715206670.266707:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1715206670.266747:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206670.266759:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206670.266769:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715206670.266793:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928320:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1715206670.266871:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd180 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.268688:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928320:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206670.268724:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.268739:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.268832:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928384:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.268920:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.270206:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928384:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.270311:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928448:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.270384:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.271555:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928448:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206670.271876:0:3124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3124:1798523504928512:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206670.271915:0:3124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421780 going to sleep for 11 seconds 00000100:00100000:3.0:1715206670.272815:0:3124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3124:1798523504928512:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206670.272838:0:3124:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206670.272844:0:3124:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206670.272846:0:3124:0:(obd_config.c:1497:class_process_config()) marker 50 (0x1) lustre-clilov rem lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:3.0:1715206670.272850:0:3124:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800a9618000 00000020:00000080:3.0:1715206670.272851:0:3124:0:(obd_config.c:1409:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1715206670.272863:0:3124:0:(lov_pool.c:634:lov_pool_remove()) lustre-OST0001_UUID removed from test_11c 00000100:00100000:3.0:1715206670.272876:0:3124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3124:1798523504928576:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206670.272908:0:3124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421780 going to sleep for 11 seconds 00000100:00100000:3.0:1715206670.273977:0:3124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3124:1798523504928576:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206670.273995:0:3124:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206670.273998:0:3124:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206670.273999:0:3124:0:(obd_config.c:1497:class_process_config()) marker 50 (0x2) lustre-clilov rem lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1715206670.274002:0:3124:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1715206670.274138:0:5364:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1715206670.274165:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206670.274174:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.274185:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206670.274206:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206670.274210:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800b6238800 from 58 10000000:01000000:2.0:1715206670.274213:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206670.274269:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.274278:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.274289:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.274307:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928640:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.274366:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.275416:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928640:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206670.275432:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.275441:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.275486:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928704:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.275536:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.276349:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928704:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.276381:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928768:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.276447:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.277426:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928768:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206670.277684:0:3125:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3125:1798523504928832:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206670.277718:0:3125:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421780 going to sleep for 11 seconds 00000100:00100000:3.0:1715206670.278763:0:3125:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3125:1798523504928832:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206670.278782:0:3125:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206670.278791:0:3125:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206670.278792:0:3125:0:(obd_config.c:1497:class_process_config()) marker 50 (0x1) lustre-clilov rem lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:3.0:1715206670.278797:0:3125:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800b6238800 00000020:00000080:3.0:1715206670.278799:0:3125:0:(obd_config.c:1409:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1715206670.278806:0:3125:0:(lov_pool.c:634:lov_pool_remove()) lustre-OST0001_UUID removed from test_11c 00000100:00100000:3.0:1715206670.278820:0:3125:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3125:1798523504928896:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206670.278854:0:3125:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421780 going to sleep for 11 seconds 00000100:00100000:3.0:1715206670.279815:0:3125:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3125:1798523504928896:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206670.279836:0:3125:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206670.279840:0:3125:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206670.279841:0:3125:0:(obd_config.c:1497:class_process_config()) marker 50 (0x2) lustre-clilov rem lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1715206670.279844:0:3125:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1715206670.279897:0:5364:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1715206670.279918:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206670.279925:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.279937:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206670.279946:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1715206670.279949:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa660000 from 1 10000000:01000000:2.0:1715206670.279951:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1715206670.279971:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.279978:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.279987:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.280004:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928960:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.280063:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.280921:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504928960:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206670.280945:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.280962:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206670.281045:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929024:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206670.281115:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206670.282047:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929024:192.168.201.123@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1715206670.282076:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1715206670.282083:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206670.282093:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206671.060836:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715206671.691685:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206671.691719:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206671.691746:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206671.691765:0:12808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510337664 00000100:00100000:1.0:1715206671.691766:0:5351:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510337600 00000100:00100000:1.0:1715206671.691772:0:5351:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510337600 00000100:00100000:0.0:1715206671.691772:0:12808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510337664 00000100:00100000:0.0:1715206671.691794:0:12808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510337728 00000100:00100000:0.0:1715206671.691795:0:12808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510337728 00000100:00100000:1.0:1715206671.691803:0:5351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 42 00000100:00100000:0.0:1715206671.691809:0:12808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 43 00000100:00100000:1.0:1715206671.691810:0:5351:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:12097:x1798523510337664:12345-192.168.201.123@tcp:104: 00000100:00100000:0.0:1715206671.691813:0:12808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:12097:x1798523510337600:12345-192.168.201.123@tcp:104: 00010000:00010000:0.0:1715206671.691822:0:12808:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206671.691823:0:5351:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206671.691873:0:5351:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1715206671.691877:0:5351:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:12097:x1798523510337664:12345-192.168.201.123@tcp:104: Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206671.691882:0:5351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 42 00010000:00010000:0.0:1715206671.691883:0:12808:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1715206671.691887:0:12808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:12097:x1798523510337600:12345-192.168.201.123@tcp:104: Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206671.691892:0:12808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 43 00000100:00100000:1.0:1715206671.691895:0:5351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 44 00000100:00100000:1.0:1715206671.691897:0:5351:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+4:12097:x1798523510337728:12345-192.168.201.123@tcp:104: 00010000:00010000:1.0:1715206671.691902:0:5351:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206671.691916:0:5351:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1715206671.691919:0:5351:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+3:12097:x1798523510337728:12345-192.168.201.123@tcp:104: Request processed in 21us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206671.691922:0:5351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 44 00010000:00010000:1.0:1715206671.691944:0:18185:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1715206671.691945:0:2527:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1715206671.691948:0:18185:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206671.691951:0:2527:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206671.691952:0:18185:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a923a640 already unused, calling callback (ffffffffa0af8a40) 10000000:00010000:1.0:1715206671.691955:0:18185:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206671.691956:0:2527:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a923a400 already unused, calling callback (ffffffffa0af8a40) 00010000:00010000:3.0:1715206671.691958:0:2469:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1715206671.691958:0:2527:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206671.691959:0:18185:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206671.691963:0:2527:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206671.691964:0:2469:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1715206671.691966:0:2527:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206671.691970:0:2469:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa6698c0 already unused, calling callback (ffffffffa0af8a40) 10000000:01000000:2.0:1715206671.691970:0:2527:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1715206671.691970:0:18185:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1715206671.691972:0:2469:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715206671.691973:0:18185:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1715206671.691977:0:2469:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1715206671.691980:0:2469:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715206671.691983:0:2469:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1715206671.691998:0:2469:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206671.691998:0:2527:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206671.691998:0:18185:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206671.692001:0:2527:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715206671.692001:0:18185:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715206671.692009:0:2469:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715206671.692016:0:2527:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206671.692017:0:2469:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206671.692017:0:18185:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206671.692020:0:2469:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800aa6698c0/0x7561918bd556fd1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ac4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206671.692020:0:2527:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800a923a400/0x7561918bd556fd24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891acb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206671.692021:0:18185:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800a923a640/0x7561918bd556fd2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891ad2 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206671.692033:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206671.692034:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206671.692034:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206671.692035:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206671.692035:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206671.692036:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206671.692036:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206671.692038:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206671.692039:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715206671.692041:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504929152:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715206671.692047:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523504929088:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206671.692049:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504929216:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715206671.692604:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504929152:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715206671.692638:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523504929088:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206671.692782:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504929216:192.168.201.123@tcp:103:ldlm_bl.0 10000000:01000000:2.0:1715206672.018698:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206672.018705:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800a9618000 from 61 10000000:01000000:2.0:1715206672.018709:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206672.018747:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a880/0x7561918bd556fd32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.018756:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a923a880/0x7561918bd556fd32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.018763:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a923a880/0x7561918bd556fd32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206672.018783:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929280:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.018843:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206672.020423:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929280:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206672.020436:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a923a880/0x7561918bd556fd32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b5e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.020456:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a923a880/0x7561918bd556fd32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891b5e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206672.020495:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929344:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.020523:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206672.021408:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929344:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.021431:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929408:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.021470:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206672.022293:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929408:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206672.022505:0:3144:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3144:1798523504929472:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206672.022546:0:3144:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a4210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206672.023363:0:3144:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3144:1798523504929472:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206672.023386:0:3144:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206672.023391:0:3144:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206672.023393:0:3144:0:(obd_config.c:1497:class_process_config()) marker 53 (0x1) lustre-clilov del lustre.test_11c 00000020:01000000:3.0:1715206672.023396:0:3144:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800a9618000 00000020:00000080:3.0:1715206672.023398:0:3144:0:(obd_config.c:1409:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1715206672.023464:0:3144:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3144:1798523504929536:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206672.023495:0:3144:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421240 going to sleep for 11 seconds 00000100:00100000:3.0:1715206672.024086:0:3144:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3144:1798523504929536:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206672.024104:0:3144:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206672.024110:0:3144:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206672.024112:0:3144:0:(obd_config.c:1497:class_process_config()) marker 53 (0x2) lustre-clilov del lustre.test_11c 00000040:00080000:3.0:1715206672.024114:0:3144:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1715206672.024190:0:5364:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1715206672.024213:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206672.024218:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a880/0x7561918bd556fd32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b5e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.024224:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a923a880/0x7561918bd556fd32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b5e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206672.024229:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206672.024230:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800b6238800 from 61 10000000:01000000:2.0:1715206672.024232:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206672.024242:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923aac0/0x7561918bd556fd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.024246:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a923aac0/0x7561918bd556fd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.024251:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a923aac0/0x7561918bd556fd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206672.024265:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929600:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.024293:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206672.024984:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929600:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206672.024994:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a923aac0/0x7561918bd556fd39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b65 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.025000:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a923aac0/0x7561918bd556fd39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891b65 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206672.025023:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929664:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.025049:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206672.025727:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929664:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.025751:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929728:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.025793:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206672.026423:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929728:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206672.026598:0:3145:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3145:1798523504929792:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206672.026633:0:3145:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421240 going to sleep for 11 seconds 00000100:00100000:3.0:1715206672.027263:0:3145:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3145:1798523504929792:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206672.027283:0:3145:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206672.027286:0:3145:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206672.027287:0:3145:0:(obd_config.c:1497:class_process_config()) marker 53 (0x1) lustre-clilov del lustre.test_11c 00000020:01000000:3.0:1715206672.027290:0:3145:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800b6238800 00000020:00000080:3.0:1715206672.027291:0:3145:0:(obd_config.c:1409:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1715206672.027326:0:3145:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3145:1798523504929856:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206672.027358:0:3145:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421240 going to sleep for 11 seconds 00000100:00100000:3.0:1715206672.027923:0:3145:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:3145:1798523504929856:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206672.027940:0:3145:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206672.027943:0:3145:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206672.027944:0:3145:0:(obd_config.c:1497:class_process_config()) marker 53 (0x2) lustre-clilov del lustre.test_11c 00000040:00080000:3.0:1715206672.027946:0:3145:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1715206672.027986:0:5364:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1715206672.027995:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206672.027998:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923aac0/0x7561918bd556fd39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b65 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.028004:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a923aac0/0x7561918bd556fd39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b65 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206672.028010:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1715206672.028015:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa660000 from 1 10000000:01000000:2.0:1715206672.028016:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1715206672.028026:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923ad00/0x7561918bd556fd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.028029:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a923ad00/0x7561918bd556fd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.028034:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a923ad00/0x7561918bd556fd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206672.028042:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929920:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.028068:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206672.028670:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929920:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206672.028679:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a923ad00/0x7561918bd556fd40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b6c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.028685:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a923ad00/0x7561918bd556fd40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891b6c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206672.028707:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929984:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206672.028727:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1715206672.029237:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504929984:192.168.201.123@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1715206672.029249:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1715206672.029251:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923ad00/0x7561918bd556fd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b6c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206672.029256:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a923ad00/0x7561918bd556fd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891b6c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206672.062732:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1715206673.016696:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715206673.016701:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715206673.016706:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715206673.016708:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715206673.016717:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715206673.016719:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:1.0:1715206673.016739:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2001:1798523504930048:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206673.016745:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2000:1798523504930112:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206673.016796:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504930240:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206673.016798:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504930176:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206673.016817:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504930304:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206673.017922:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2001:1798523504930048:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206673.017924:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2000:1798523504930112:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206673.017931:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504930176:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206673.017935:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504930240:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206673.017937:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504930304:192.168.201.123@tcp:400:kworker.0 00010000:00010000:0.0:1715206673.064686:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206674.066768:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206675.068786:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715206675.222635:0:3443:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 18:17:54 (1715206674) 00000080:00200008:1.0:1715206675.305304:0:3486:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206675.305317:0:3486:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715206675.305334:0:3486:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206675.305350:0:3486:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206675.305362:0:3486:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206675.305371:0:3486:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715206675.305374:0:3486:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:1.0:1715206675.305379:0:3486:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a939bcc8 00010000:00010000:1.0:1715206675.305383:0:3486:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206675.305389:0:3486:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715206675.305749:0:3486:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206675.305753:0:3486:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206675.305764:0:3486:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206675.305800:0:3486:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305807:0:3486:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305815:0:3486:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3486 initiator: MDT0 00000100:00100000:1.0:1715206675.305829:0:3486:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7ddf00 going to sleep for 0 seconds 00000100:00100000:1.0:1715206675.305837:0:3486:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967a300 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:04532c2b-e5e9-420d-abb0-4480aab1e378:3486:1798523504930368:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715206675.305850:0:3486:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305856:0:3486:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305860:0:3486:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305864:0:3486:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305869:0:3486:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305873:0:3486:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa668900 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206675.305876:0:3486:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305880:0:3486:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305886:0:3486:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305890:0:3486:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206675.305894:0:3486:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3486 initiator: MDT0 00010000:00010000:1.0:1715206675.305899:0:3486:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3486 initiator: MDT0 00000080:00020000:1.0:1715206675.305914:0:3486:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715206675.305927:0:3486:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206675.305934:0:3486:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715206675.305940:0:3486:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206675.305945:0:3486:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206675.305951:0:3486:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206675.305957:0:3486:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715206675.305959:0:3486:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:1.0:1715206675.305962:0:3486:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a939bcc8 00010000:00010000:1.0:1715206675.305964:0:3486:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206675.305969:0:3486:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206675.306028:0:3486:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715206675.306035:0:3486:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206675.306040:0:3486:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206675.306046:0:3486:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206675.306051:0:3486:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715206675.306053:0:3486:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:1.0:1715206675.306056:0:3486:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a939bb80 00010000:00010000:1.0:1715206675.306058:0:3486:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206675.306067:0:3486:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206675.306074:0:3486:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715206675.306079:0:3486:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715206675.306707:0:3487:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206675.306720:0:3487:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206675.306727:0:3487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206675.306736:0:3487:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206675.306748:0:3487:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206675.306750:0:3487:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206675.306754:0:3487:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a9117b80 00010000:00010000:3.0:1715206675.306756:0:3487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206675.306762:0:3487:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206675.306769:0:3487:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715206675.306772:0:3487:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715206675.306790:0:3487:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206675.306794:0:3487:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206675.306799:0:3487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206675.306804:0:3487:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206675.306809:0:3487:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206675.306811:0:3487:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206675.306812:0:3487:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a9117bb0 00010000:00010000:3.0:1715206675.306814:0:3487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206675.306819:0:3487:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206675.306832:0:3487:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206675.306836:0:3487:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:3.0:1715206675.306839:0:3487:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff880136f410c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206675.306846:0:3487:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), file ffff8800a9156900, open_flags 8000, mode 0 opened 0 00000080:00200000:3.0:1715206675.306850:0:3487:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), intent=open 00000002:00010000:3.0:1715206675.306858:0:3487:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:3.0:1715206675.306883:0:3487:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.306888:0:3487:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 3487 initiator: MDT0 00000020:00100000:3.0:1715206675.306896:0:3487:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1715206675.306903:0:3487:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012a412d80 x1798523504930496/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1715206675.306910:0:3487:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 3487 initiator: MDT0 00000100:00100000:3.0:1715206675.306943:0:3487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504930496:192.168.201.123@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1715206675.307113:0:3487:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369540 going to sleep for 143 seconds 00000100:00100000:3.0:1715206675.309585:0:3487:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504930496:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715206675.309600:0:3487:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309608:0:3487:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309613:0:3487:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309626:0:3487:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309632:0:3487:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309636:0:3487:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa549f80 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715206675.309639:0:3487:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309643:0:3487:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309648:0:3487:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309653:0:3487:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206675.309656:0:3487:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 3487 initiator: MDT0 00010000:00010000:3.0:1715206675.309661:0:3487:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fd4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 3487 initiator: MDT0 00000002:00100000:3.0:1715206675.309688:0:3487:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012a412d80 x1798523504930496/t4294967386(4294967386) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206823 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:3.0:1715206675.309699:0:3487:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a412d80 x1798523504930496/t4294967386(4294967386) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206823 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:3.0:1715206675.309720:0:3487:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 4096 00000080:00200000:3.0:1715206675.309723:0:3487:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b02788c8): rc = 0 00000080:00010000:3.0:1715206675.309727:0:3487:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b02788c8) for lock 0x0 00000080:00200008:3.0:1715206675.309742:0:3487:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:3.0:1715206675.309764:0:3487:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a412d80 x1798523504930496/t4294967386(4294967386) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206823 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:3.0:1715206675.309817:0:3487:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b02788c8), inode mode 4040 mask 44 00000080:00200080:3.0:1715206675.309877:0:3487:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=8950f0 00800000:00000080:3.0:1715206675.309889:0:3487:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a93cf7a0 uarg=0000000000000000 00000002:00000080:3.0:1715206675.309900:0:3487:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a93cf7a0 uarg=0000000000000000 00000100:00100000:3.0:1715206675.309942:0:3487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a410000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504930560:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715206675.310004:0:3487:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369600 going to sleep for 143 seconds 00000100:00100000:3.0:1715206675.310991:0:3487:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a410000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504930560:192.168.201.123@tcp:59:lhsmtool_posix.0 00000002:00000080:3.0:1715206675.311002:0:3487:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a93cf7a0 uarg=0000000000000000 00000100:00100000:3.0:1715206675.311016:0:3487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a410000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504930624:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715206675.311045:0:3487:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369600 going to sleep for 143 seconds 00000100:00100000:1.0:1715206675.311921:0:3487:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a410000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504930624:192.168.201.123@tcp:59:lhsmtool_posix.0 00000080:00200000:2.0:1715206675.315137:0:3488:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:2.0:1715206675.315167:0:3488:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206675.315193:0:3488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315199:0:3488:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315206:0:3488:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00000100:00100000:2.0:1715206675.315214:0:3488:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f900 going to sleep for 0 seconds 00000100:00100000:2.0:1715206675.315219:0:3488:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:3488:1798523504930688:192.168.201.123@tcp:101:lfs.0 00010000:00010000:2.0:1715206675.315225:0:3488:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315230:0:3488:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315234:0:3488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315239:0:3488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315243:0:3488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315246:0:3488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a923af40 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:2.0:1715206675.315249:0:3488:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315260:0:3488:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315265:0:3488:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315269:0:3488:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206675.315272:0:3488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315276:0:3488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923af40/0x7561918bd556fd55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3488 initiator: MDT0 00000080:00020000:2.0:1715206675.315289:0:3488:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:2.0:1715206675.315307:0:3488:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:2.0:1715206675.315313:0:3488:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206675.315326:0:3488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315330:0:3488:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315335:0:3488:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00000100:00100000:2.0:1715206675.315341:0:3488:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f900 going to sleep for 0 seconds 00000100:00100000:2.0:1715206675.315345:0:3488:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:3488:1798523504930752:192.168.201.123@tcp:101:lfs.0 00010000:00010000:2.0:1715206675.315349:0:3488:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315353:0:3488:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315364:0:3488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315368:0:3488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315372:0:3488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315375:0:3488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a923b180 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:2.0:1715206675.315377:0:3488:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315381:0:3488:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315385:0:3488:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315388:0:3488:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206675.315390:0:3488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315394:0:3488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b180/0x7561918bd556fd5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3488 initiator: MDT0 00000080:00020000:2.0:1715206675.315404:0:3488:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715206675.315415:0:3488:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715206675.315418:0:3488:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:2.0:1715206675.315423:0:3488:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206675.315434:0:3488:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315443:0:3488:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315448:0:3488:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00000100:00100000:2.0:1715206675.315453:0:3488:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f900 going to sleep for 0 seconds 00000100:00100000:2.0:1715206675.315457:0:3488:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:3488:1798523504930816:192.168.201.123@tcp:101:lfs.0 00010000:00010000:2.0:1715206675.315461:0:3488:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315465:0:3488:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315469:0:3488:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315473:0:3488:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315477:0:3488:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315480:0:3488:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a923b3c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:2.0:1715206675.315482:0:3488:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315486:0:3488:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315489:0:3488:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315498:0:3488:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206675.315500:0:3488:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3488 initiator: MDT0 00010000:00010000:2.0:1715206675.315504:0:3488:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a923b3c0/0x7561918bd556fd63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3488 initiator: MDT0 00000080:00020000:2.0:1715206675.315514:0:3488:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715206675.398315:0:3525:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206675.398337:0:3525:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206675.398381:0:3525:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398389:0:3525:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398398:0:3525:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3525 initiator: MDT0 00000100:00100000:1.0:1715206675.398412:0:3525:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd0c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715206675.398422:0:3525:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967a300 pname:cluuid:pid:xid:nid:opc:job mkdir:04532c2b-e5e9-420d-abb0-4480aab1e378:3525:1798523504930880:192.168.201.123@tcp:101:mkdir.0 00010000:00010000:1.0:1715206675.398432:0:3525:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398438:0:3525:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398443:0:3525:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398449:0:3525:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398460:0:3525:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398465:0:3525:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa668d80 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206675.398469:0:3525:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398474:0:3525:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398480:0:3525:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398484:0:3525:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206675.398489:0:3525:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3525 initiator: MDT0 00010000:00010000:1.0:1715206675.398494:0:3525:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 3525 initiator: MDT0 00000080:00020000:1.0:1715206675.398512:0:3525:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000001:02000400:3.0:1715206675.752106:0:3660:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12a: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d12a.sanity-hsm' 00010000:00010000:3.0:1715206676.070767:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 557 lines, 557 kept, 0 dropped, 0 bad.