00010000:00010000:2.0F:1721219099.796787:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1721219100.711471:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219100.711510:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219100.711533:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459540352 00000100:00100000:2.0:1721219100.711541:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459540416 00000100:00100000:3.0:1721219100.711559:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181481 00000100:00100000:3.0:1721219100.711563:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8985a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:6699:x1804827459540352:12345-192.168.201.158@tcp:104: 00000100:00100000:2.0:1721219100.711566:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181482 00000100:00100000:2.0:1721219100.711571:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8986880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:6699:x1804827459540416:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219100.711613:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219100.711617:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8985a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:6699:x1804827459540352:12345-192.168.201.158@tcp:104: Request processed in 54us (151us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219100.711618:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219100.711622:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181481 00000100:00100000:2.0:1721219100.711623:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8986880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:6699:x1804827459540416:12345-192.168.201.158@tcp:104: Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219100.711629:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181482 00010000:00010000:2.0:1721219100.711646:0:4614:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0F:1721219100.711649:0:11546:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1721219100.711650:0:4614:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7293a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001085 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219100.711674:0:11546:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9bacfc0/0xe0b47d8ca5f72933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00107e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219100.711683:0:4614:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8deef40 already unused, calling callback (ffffffffa030c5c0) 00010000:00010000:1.0:1721219100.711683:0:11546:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9bacfc0 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:2.0:1721219100.711685:0:4614:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7293a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001085 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219100.711685:0:11546:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9bacfc0/0xe0b47d8ca5f72933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00107e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219100.711691:0:4614:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001085 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219100.711691:0:11546:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9bacfc0/0xe0b47d8ca5f72933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00107e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219100.711696:0:11546:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9bacfc0/0xe0b47d8ca5f72933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00107e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219100.711697:0:4614:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001085 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219100.711701:0:4614:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1721219100.711701:0:11546:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219100.711734:0:4614:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7293a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001085 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219100.711735:0:11546:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9bacfc0/0xe0b47d8ca5f72933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00107e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219100.711740:0:4614:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219100.711740:0:11546:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219100.711753:0:11546:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9bacfc0/0xe0b47d8ca5f72933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00107e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219100.711755:0:4614:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7293a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001085 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219100.711757:0:11546:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9bacfc0/0xe0b47d8ca5f72933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00107e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219100.711760:0:4614:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7293a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001085 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219100.711766:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219100.711766:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219100.711767:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219100.711772:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721219100.711777:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86004c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511240256:192.168.201.158@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219100.711780:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511240320:192.168.201.158@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1721219100.711783:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219100.711784:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219100.711786:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219100.712293:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86004c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511240256:192.168.201.158@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219100.712406:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511240320:192.168.201.158@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1721219100.798803:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219101.800777:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0F:1721219102.540731:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219102.540749:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 82 10000000:01000000:0.0:1721219102.540753:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219102.540788:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219102.540796:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219102.540804:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219102.540829:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240384:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219102.540895:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219102.542449:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240384:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219102.542463:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219102.542471:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219102.542513:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240448:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219102.542544:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219102.543686:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240448:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219102.543713:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240512:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219102.543758:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219102.544954:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240512:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219102.545183:0:17246:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17246:1804827511240576:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219102.545234:0:17246:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219102.546426:0:17246:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17246:1804827511240576:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219102.546448:0:17246:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219102.546454:0:17246:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219102.546456:0:17246:0:(obd_config.c:1460:class_process_config()) marker 52 (0x1) lustre-clilov rem lustre.test_20d.lustre-OST0000_UUID 00000020:01000000:1.0:1721219102.546460:0:17246:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219102.546461:0:17246:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1721219102.546470:0:17246:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from test_20d 00000100:00100000:1.0:1721219102.546483:0:17246:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17246:1804827511240640:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219102.546519:0:17246:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219102.547573:0:17246:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17246:1804827511240640:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219102.547591:0:17246:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219102.547594:0:17246:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219102.547595:0:17246:0:(obd_config.c:1460:class_process_config()) marker 52 (0x2) lustre-clilov rem lustre.test_20d.lustre-OST0000_UUID 00000040:00080000:1.0:1721219102.547597:0:17246:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 85 count 84 00000020:01000000:0.0:1721219102.547642:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 82-84 (rc=0) 10000000:01000000:0.0:1721219102.547682:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219102.547687:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219102.547695:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219102.547702:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219102.547703:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219102.547705:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219102.547716:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219102.547722:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219102.547727:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219102.547738:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240704:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219102.547770:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219102.548427:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240704:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219102.548435:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219102.548440:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219102.548462:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240768:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219102.548486:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219102.549363:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240768:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219102.549379:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219102.549382:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219102.549387:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219102.802780:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219103.168142:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219103.168176:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219103.168204:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459543168 00000100:00100000:3.0:1721219103.168229:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459543232 00000100:00100000:2.0:1721219103.168237:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181483 00000100:00100000:3.0:1721219103.168243:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181484 00000100:00100000:2.0:1721219103.168243:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8986d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:6851:x1804827459543168:12345-192.168.201.158@tcp:104: 00000100:00100000:3.0:1721219103.168247:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8987200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:6851:x1804827459543232:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219103.168297:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219103.168301:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8987200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:6851:x1804827459543232:12345-192.168.201.158@tcp:104: Request processed in 54us (125us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219103.168302:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219103.168306:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8986d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:6851:x1804827459543168:12345-192.168.201.158@tcp:104: Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219103.168307:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181484 00000100:00100000:2.0:1721219103.168310:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181483 00010000:00010000:3.0:1721219103.168328:0:4613:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1721219103.168332:0:4613:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219103.168362:0:4613:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8deef40 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:3.0:1721219103.168371:0:4613:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219103.168374:0:11574:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219103.168376:0:4613:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219103.168378:0:11574:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219103.168380:0:4613:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219103.168383:0:4613:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219103.168385:0:11574:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dee400 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219103.168386:0:11574:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219103.168390:0:11574:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219103.168393:0:11574:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219103.168397:0:11574:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219103.168414:0:4613:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219103.168414:0:11574:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219103.168418:0:4613:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219103.168419:0:11574:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219103.168431:0:4613:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219103.168433:0:11574:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219103.168435:0:4613:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8deef40/0xe0b47d8ca5f7295d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001157 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219103.168438:0:11574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f72964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00115e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219103.168446:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219103.168447:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219103.168448:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219103.168459:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511240896:192.168.201.158@tcp:103:ldlm_bl_07.0 00000100:00100000:2.0:1721219103.168460:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8984c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511240832:192.168.201.158@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1721219103.168462:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219103.168463:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219103.168464:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219103.169061:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8984c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511240832:192.168.201.158@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1721219103.169064:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511240896:192.168.201.158@tcp:103:ldlm_bl_07.0 00010000:00010000:1.0:1721219103.804835:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1721219104.239752:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1721219104.239759:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 85 10000000:01000000:1.0:1721219104.239766:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1721219104.239806:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219104.239821:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219104.239851:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219104.239879:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240960:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1721219104.239972:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219104.241368:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511240960:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219104.241381:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219104.241387:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219104.241421:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511241024:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219104.241446:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219104.242733:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511241024:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219104.242783:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511241088:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219104.242852:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219104.244290:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511241088:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219104.244439:0:17278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17278:1804827511241152:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219104.244473:0:17278:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219104.246222:0:17278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17278:1804827511241152:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219104.246258:0:17278:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219104.246273:0:17278:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219104.246275:0:17278:0:(obd_config.c:1460:class_process_config()) marker 54 (0x1) lustre-clilov del lustre.test_20d 00000020:01000000:1.0:1721219104.246281:0:17278:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219104.246283:0:17278:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1721219104.246388:0:17278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17278:1804827511241216:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219104.246420:0:17278:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219104.247611:0:17278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17278:1804827511241216:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219104.247629:0:17278:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219104.247631:0:17278:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219104.247632:0:17278:0:(obd_config.c:1460:class_process_config()) marker 54 (0x2) lustre-clilov del lustre.test_20d 00000040:00080000:1.0:1721219104.247635:0:17278:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 88 count 87 00000020:01000000:2.0:1721219104.247672:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 85-87 (rc=0) 10000000:01000000:2.0:1721219104.247687:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219104.247690:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219104.247696:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219104.247701:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1721219104.247702:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:2.0:1721219104.247703:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1721219104.247714:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219104.247717:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219104.247726:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219104.247734:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86004c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511241280:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219104.247784:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162b40 going to sleep for 6 seconds 00000100:00100000:0.0:1721219104.248993:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86004c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511241280:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219104.249011:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219104.249021:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219104.249071:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b179300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511241344:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219104.249121:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219104.250423:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b179300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511241344:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219104.250439:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219104.250441:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219104.250447:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219104.314805:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511241472:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219104.314812:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511241408:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219104.314865:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511241536:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219104.316138:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511241408:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219104.316147:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511241472:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219104.316152:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511241536:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1721219104.806787:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219105.808770:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1721219106.240678:0:17552:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219106.240681:0:17552:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 20e: ENOSPC with next real comp: spillover and backward extension ========================================================== 08:25:05 (1721219105) 00000080:00200000:1.0:1721219106.259551:0:17416:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219106.259565:0:17416:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219106.259576:0:17416:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.259585:0:17416:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219106.259592:0:17416:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219106.259593:0:17416:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219106.259598:0:17416:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8057af8 00010000:00010000:1.0:1721219106.259604:0:17416:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.259608:0:17416:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219106.259618:0:17416:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:1.0:1721219106.259623:0:17416:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1 00000080:00200000:1.0:1721219106.259625:0:17416:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=getattr 00000002:00010000:1.0:1721219106.259630:0:17416:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d20e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1721219106.259672:0:17416:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.259676:0:17416:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.259682:0:17416:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219106.259697:0:17416:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862aac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:17416:1804827511241600:192.168.201.158@tcp:101:bash.0 00000100:00100000:1.0:1721219106.259746:0:17416:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5f00 going to sleep for 90 seconds 00000100:00100000:1.0:1721219106.261102:0:17416:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862aac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:17416:1804827511241600:192.168.201.158@tcp:101:bash.0 00010000:00010000:1.0:1721219106.261109:0:17416:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261115:0:17416:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261118:0:17416:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261126:0:17416:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261129:0:17416:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261133:0:17416:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a81cdb00 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:1.0:1721219106.261135:0:17416:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261138:0:17416:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261141:0:17416:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261145:0:17416:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1721219106.261147:0:17416:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261150:0:17416:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81cdb00/0xe0b47d8ca5f72979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1721219106.261157:0:17416:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a862aac0 x1804827511241600/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219197 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:1.0:1721219106.261170:0:17416:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:1.0:1721219106.261213:0:17416:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219106.261217:0:17416:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1721219106.261223:0:17416:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:1.0:1721219106.261235:0:17416:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261238:0:17416:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.261242:0:17416:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219106.261249:0:17416:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862aac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:17416:1804827511241664:192.168.201.158@tcp:101:bash.0 00000100:00100000:1.0:1721219106.261275:0:17416:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5f00 going to sleep for 90 seconds 00000100:00100000:1.0:1721219106.262117:0:17416:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862aac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:17416:1804827511241664:192.168.201.158@tcp:101:bash.0 00010000:00010000:1.0:1721219106.262125:0:17416:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.262131:0:17416:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.262137:0:17416:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.262141:0:17416:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.262145:0:17416:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.262147:0:17416:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.262157:0:17416:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1721219106.262162:0:17416:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a862aac0 x1804827511241664/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 576/688 e 0 to 0 dl 1721219197 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:1.0:1721219106.262167:0:17416:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.262171:0:17416:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1721219106.262182:0:17416:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 13824 00000080:00010000:1.0:1721219106.262185:0:17416:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f72980 00000080:00010000:1.0:1721219106.262187:0:17416:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219106.262188:0:17416:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72980 from it ffff8800a8057cf8 00010000:00010000:1.0:1721219106.262189:0:17416:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.262193:0:17416:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219106.264122:0:17569:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219106.264127:0:17569:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219106.264131:0:17569:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264135:0:17569:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219106.264139:0:17569:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219106.264143:0:17569:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219106.264145:0:17569:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8afbb58 00010000:00010000:1.0:1721219106.264147:0:17569:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264150:0:17569:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219106.264155:0:17569:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:1.0:1721219106.264159:0:17569:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1536 00000080:00200000:1.0:1721219106.264160:0:17569:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219106.264162:0:17569:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219106.264164:0:17569:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264167:0:17569:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219106.264171:0:17569:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219106.264172:0:17569:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219106.264173:0:17569:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8afbbf8 00010000:00010000:1.0:1721219106.264174:0:17569:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264176:0:17569:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219106.264179:0:17569:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:1.0:1721219106.264181:0:17569:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219106.264186:0:17569:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219106.264188:0:17569:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264191:0:17569:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219106.264194:0:17569:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219106.264195:0:17569:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219106.264196:0:17569:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8afbda0 00010000:00010000:1.0:1721219106.264197:0:17569:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264200:0:17569:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219106.264203:0:17569:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:1.0:1721219106.264204:0:17569:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8) 00010000:00010000:1.0:1721219106.264216:0:17569:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264223:0:17569:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264238:0:17569:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219106.264241:0:17569:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219106.264242:0:17569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a81ccfc0/0xe0b47d8ca5f72980 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e0011f8 expref: -99 pid: 17416 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1721219106.264256:0:17569:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1721219106.264259:0:17569:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a862aac0 x1804827511241792/t0(0) o36->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1721219106.264269:0:17569:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862aac0 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:17569:1804827511241792:192.168.201.158@tcp:36:mkdir.0 00000100:00100000:1.0:1721219106.264314:0:17569:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5f00 going to sleep for 90 seconds 00000100:00100000:1.0:1721219106.266059:0:17569:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862aac0 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:17569:1804827511241792:192.168.201.158@tcp:36:mkdir.0 00000080:00200000:1.0:1721219106.266077:0:17569:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a0b:0x0](ffff880136eb6d58) 00000080:00200000:1.0:1721219106.266080:0:17569:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a0b:0x0], updating i_size 512 00010000:00010000:3.0:1721219106.810864:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219107.812870:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219108.814820:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219109.322941:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b179300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511241856:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219109.322944:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511241920:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219109.323013:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511242048:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219109.323016:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511241984:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219109.324571:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b179300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511241856:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219109.324584:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511241920:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219109.324585:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511241984:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219109.324595:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511242048:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1721219109.816801:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219110.818859:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219111.820768:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219112.822709:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219113.824864:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219114.330833:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511242176:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219114.330858:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511242112:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219114.330904:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511242240:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219114.330906:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511242304:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219114.332208:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511242112:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219114.332216:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511242240:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219114.332216:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511242176:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219114.332223:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511242304:192.168.201.158@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1721219114.826796:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219115.537449:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219115.537500:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219115.537527:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459547328 00000100:00100000:2.0:1721219115.537527:0:4606:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459547392 00000100:00100000:3.0:1721219115.537560:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181485 00000100:00100000:2.0:1721219115.537573:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181486 00000100:00100000:3.0:1721219115.537574:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a86004c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:7712:x1804827459547328:12345-192.168.201.158@tcp:104: 00000100:00100000:2.0:1721219115.537578:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:7712:x1804827459547392:12345-192.168.201.158@tcp:104: 00010000:00010000:2.0:1721219115.537632:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1721219115.537636:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219115.537636:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:7712:x1804827459547392:12345-192.168.201.158@tcp:104: Request processed in 59us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219115.537641:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a86004c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:7712:x1804827459547328:12345-192.168.201.158@tcp:104: Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219115.537641:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181486 00000100:00100000:3.0:1721219115.537647:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181485 00010000:00010000:0.0:1721219115.537677:0:4613:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1721219115.537683:0:4613:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219115.537694:0:4613:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a81ced00 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219115.537696:0:4613:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219115.537703:0:4613:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219115.537708:0:11574:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1721219115.537709:0:4613:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219115.537711:0:11574:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219115.537713:0:4613:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219115.537717:0:11574:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9bad680 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:3.0:1721219115.537719:0:11574:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219115.537724:0:11574:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219115.537728:0:11574:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219115.537733:0:11574:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219115.537753:0:11574:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219115.537755:0:4613:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219115.537757:0:11574:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219115.537761:0:4613:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219115.537768:0:11574:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219115.537771:0:11574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0011d5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219115.537773:0:4613:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219115.537778:0:4613:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a81ced00/0xe0b47d8ca5f7296b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0011ce expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219115.537780:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219115.537781:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511242432:192.168.201.158@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1721219115.537782:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511242368:192.168.201.158@tcp:103:ldlm_bl_07.0 00010000:00010000:3.0:1721219115.537784:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219115.537785:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219115.537792:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219115.537793:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219115.537794:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219115.538329:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511242368:192.168.201.158@tcp:103:ldlm_bl_07.0 00000100:00100000:1.0:1721219115.538528:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511242432:192.168.201.158@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1721219115.828806:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219116.830774:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1721219117.409733:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1721219117.409739:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 88 10000000:01000000:1.0:1721219117.409743:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1721219117.409775:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219117.409782:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219117.409789:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219117.409806:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242496:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1721219117.409868:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5b40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219117.411345:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242496:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219117.411358:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219117.411364:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219117.411399:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242560:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219117.411426:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5b40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219117.412287:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242560:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219117.412309:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242624:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219117.412356:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5b40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219117.413305:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242624:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219117.413440:0:17765:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17765:1804827511242688:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219117.413467:0:17765:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5b40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219117.414428:0:17765:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17765:1804827511242688:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219117.414447:0:17765:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219117.414452:0:17765:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219117.414453:0:17765:0:(obd_config.c:1460:class_process_config()) marker 56 (0x1) lustre-clilov new lustre.test_20e 00000020:01000000:1.0:1721219117.414456:0:17765:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219117.414457:0:17765:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1721219117.414471:0:17765:0:(lov_pool.c:313:lov_pool_new()) test_20e is pool #2 00000100:00100000:1.0:1721219117.414482:0:17765:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17765:1804827511242752:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219117.414515:0:17765:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5e40 going to sleep for 6 seconds 00000100:00100000:1.0:1721219117.415309:0:17765:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17765:1804827511242752:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219117.415325:0:17765:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219117.415328:0:17765:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219117.415328:0:17765:0:(obd_config.c:1460:class_process_config()) marker 56 (0x2) lustre-clilov new lustre.test_20e 00000040:00080000:1.0:1721219117.415330:0:17765:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 91 count 90 00000020:01000000:2.0:1721219117.415365:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 88-90 (rc=0) 10000000:01000000:2.0:1721219117.415379:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219117.415382:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219117.415387:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219117.415395:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1721219117.415396:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:2.0:1721219117.415397:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1721219117.415407:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219117.415410:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219117.415414:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219117.415421:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8607200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242816:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219117.415441:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b61623c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219117.416058:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8607200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242816:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219117.416067:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219117.416073:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219117.416119:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242880:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219117.416144:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0240 going to sleep for 6 seconds 00000100:00100000:0.0:1721219117.416782:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511242880:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219117.416799:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219117.416802:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219117.416809:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219117.832742:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219118.034059:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219118.034123:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219118.034148:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459550976 00000100:00100000:2.0:1721219118.034152:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459551040 00000100:00100000:2.0:1721219118.034177:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181487 00000100:00100000:2.0:1721219118.034181:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8603440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:8004:x1804827459551040:12345-192.168.201.158@tcp:104: 00000100:00100000:3.0:1721219118.034186:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181488 00000100:00100000:3.0:1721219118.034191:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8603dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:8004:x1804827459550976:12345-192.168.201.158@tcp:104: 00010000:00010000:2.0:1721219118.034236:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219118.034240:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8603440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:8004:x1804827459551040:12345-192.168.201.158@tcp:104: Request processed in 60us (118us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219118.034242:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219118.034245:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181487 00000100:00100000:3.0:1721219118.034248:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8603dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:8004:x1804827459550976:12345-192.168.201.158@tcp:104: Request processed in 56us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219118.034255:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181488 00010000:00010000:0.0:1721219118.034264:0:11573:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1721219118.034270:0:11573:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219118.034273:0:9881:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219118.034276:0:9881:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219118.034279:0:11573:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a81cef40 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219118.034281:0:11573:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219118.034284:0:9881:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9badb00 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:3.0:1721219118.034286:0:9881:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219118.034287:0:11573:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219118.034306:0:11573:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219118.034308:0:9881:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219118.034310:0:11573:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1721219118.034313:0:9881:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219118.034318:0:9881:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219118.034347:0:9881:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219118.034348:0:11573:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219118.034353:0:9881:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219118.034354:0:11573:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219118.034367:0:11573:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219118.034372:0:11573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a81cef40/0xe0b47d8ca5f72987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001214 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219118.034376:0:9881:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219118.034384:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721219118.034386:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219118.034387:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219118.034389:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219118.034390:0:9881:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f7298e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00121b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219118.034395:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511242944:192.168.201.158@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1721219118.034397:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511243008:192.168.201.158@tcp:103:ldlm_bl_06.0 00010000:00010000:3.0:1721219118.034405:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219118.034406:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219118.034408:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219118.035064:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511242944:192.168.201.158@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1721219118.035204:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511243008:192.168.201.158@tcp:103:ldlm_bl_06.0 00010000:00010000:3.0:1721219118.834782:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219119.338861:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511243072:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219119.338861:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511243136:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219119.338925:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511243264:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219119.338927:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511243200:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219119.340223:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511243136:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219119.340230:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511243264:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219119.340238:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511243072:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219119.340248:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511243200:192.168.201.158@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1721219119.836836:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1721219120.000818:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219120.000834:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 91 10000000:01000000:2.0:1721219120.000840:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219120.000873:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f72995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219120.000883:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f72995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219120.000891:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f72995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219120.000914:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243328:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219120.000983:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b61623c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219120.002716:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243328:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219120.002732:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f72995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0012ed expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219120.002738:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f72995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0012ed expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219120.002782:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243392:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219120.002815:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce03c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219120.003746:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243392:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219120.003766:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243456:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219120.003801:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce03c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219120.004711:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243456:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219120.004903:0:17810:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17810:1804827511243520:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219120.004947:0:17810:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5900 going to sleep for 6 seconds 00000100:00100000:1.0:1721219120.005880:0:17810:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17810:1804827511243520:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219120.005904:0:17810:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219120.005911:0:17810:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219120.005913:0:17810:0:(obd_config.c:1460:class_process_config()) marker 58 (0x1) lustre-clilov add lustre.test_20e.lustre-OST0000_UUID 00000100:00100000:1.0:1721219120.005927:0:17810:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17810:1804827511243584:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219120.005964:0:17810:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5900 going to sleep for 6 seconds 00000100:00100000:1.0:1721219120.006818:0:17810:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17810:1804827511243584:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219120.006839:0:17810:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219120.006842:0:17810:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1721219120.006850:0:17810:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_20e as member 1 00000100:00100000:1.0:1721219120.006864:0:17810:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17810:1804827511243648:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219120.006899:0:17810:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5900 going to sleep for 6 seconds 00000100:00100000:1.0:1721219120.007541:0:17810:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:17810:1804827511243648:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219120.007558:0:17810:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219120.007561:0:17810:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219120.007562:0:17810:0:(obd_config.c:1460:class_process_config()) marker 58 (0x2) lustre-clilov add lustre.test_20e.lustre-OST0000_UUID 00000040:00080000:1.0:1721219120.007565:0:17810:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 94 count 93 00000020:01000000:0.0:1721219120.007618:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 91-93 (rc=0) 10000000:01000000:0.0:1721219120.007633:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219120.007636:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f72995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0012ed expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219120.007641:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9badb00/0xe0b47d8ca5f72995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0012ed expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219120.007646:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219120.007651:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219120.007666:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219120.007676:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f7299c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219120.007680:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f7299c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219120.007683:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f7299c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219120.007691:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243712:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219120.007710:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce03c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219120.008335:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243712:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219120.008342:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f7299c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0012f4 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219120.008346:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f7299c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0012f4 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219120.008365:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243776:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219120.008388:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce03c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219120.009032:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511243776:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219120.009044:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219120.009046:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f7299c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0012f4 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219120.009050:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8dee400/0xe0b47d8ca5f7299c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0012f4 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219120.284753:0:17831:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219120.284771:0:17831:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219120.284786:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.284800:0:17831:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219120.284812:0:17831:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219120.284815:0:17831:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219120.284822:0:17831:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a9073af8 00010000:00010000:3.0:1721219120.284825:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.284834:0:17831:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219120.284849:0:17831:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:3.0:1721219120.284859:0:17831:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=16 00000080:00200000:3.0:1721219120.284869:0:17831:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d20e.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=0 00000002:00010000:3.0:1721219120.284878:0:17831:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d20e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219120.284918:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.284927:0:17831:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.284937:0:17831:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219120.284961:0:17831:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511243840:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219120.285042:0:17831:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6cefc00 going to sleep for 90 seconds 00000100:00100000:3.0:1721219120.286638:0:17831:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511243840:192.168.201.158@tcp:101:lfs.0 00010000:00010000:3.0:1721219120.286679:0:17831:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286695:0:17831:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286703:0:17831:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286713:0:17831:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286723:0:17831:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286750:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286757:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286764:0:17831:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219120.286775:0:17831:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a8985f00 x1804827511243840/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219211 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1721219120.286787:0:17831:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286797:0:17831:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589935617/27147 (0 0) 00000080:00200000:3.0:1721219120.286813:0:17831:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a0b:0x0], updating i_size 11776 00000080:00200000:3.0:1721219120.286816:0:17831:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6a0b:0x0](ffff880136eb6d58): rc = 0 00000080:00010000:3.0:1721219120.286822:0:17831:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a0b:0x0](ffff880136eb6d58) for lock 0xe0b47d8ca5f729a3 00000080:00010000:3.0:1721219120.286831:0:17831:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x6a0b:0x0](ffff880136eb6d58) 00000080:00010000:3.0:1721219120.286833:0:17831:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f729a3 from it ffff8800a9073a70 00010000:00010000:3.0:1721219120.286836:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286843:0:17831:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219120.286864:0:17831:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a0b:0x0](ffff880136eb6d58), inode mode 41ed mask 1 00000080:00200000:3.0:1721219120.286878:0:17831:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x6a0b:0x0](ffff880136eb6d58), flags=0 00000080:00200000:3.0:1721219120.286881:0:17831:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x6a0b:0x0](ffff880136eb6d58), intent=getattr 00000002:00010000:3.0:1721219120.286889:0:17831:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f20e.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x6a0b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1721219120.286912:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286920:0:17831:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.286928:0:17831:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219120.286943:0:17831:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511243904:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219120.286985:0:17831:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6cefc00 going to sleep for 90 seconds 00000100:00100000:3.0:1721219120.288209:0:17831:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511243904:192.168.201.158@tcp:101:lfs.0 00010000:00010000:3.0:1721219120.288219:0:17831:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288227:0:17831:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288232:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288236:0:17831:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288242:0:17831:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288253:0:17831:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f87b180 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:3.0:1721219120.288256:0:17831:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288260:0:17831:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288265:0:17831:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288269:0:17831:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1721219120.288272:0:17831:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288276:0:17831:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f729aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219120.288285:0:17831:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a8985f00 x1804827511243904/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219211 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:3.0:1721219120.288299:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288305:0:17831:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219120.288309:0:17831:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f729a3 from it ffff8800a90739f0 00010000:00010000:3.0:1721219120.288310:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288322:0:17831:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219120.288355:0:17831:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219120.288362:0:17831:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219120.288368:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288375:0:17831:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219120.288383:0:17831:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219120.288385:0:17831:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219120.288389:0:17831:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a9073bb0 00010000:00010000:3.0:1721219120.288391:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288399:0:17831:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219120.288407:0:17831:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:3.0:1721219120.288413:0:17831:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d20e.sanity-pfl, flags=17 00000080:00200000:3.0:1721219120.288415:0:17831:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a0b:0x0](ffff880136eb6d58), inode mode 41ed mask 1 00000080:00200000:3.0:1721219120.288421:0:17831:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f20e.sanity-pfl, flags=769 00000080:00200000:3.0:1721219120.288423:0:17831:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a0b:0x0](ffff880136eb6d58), inode mode 41ed mask 3 00000080:00200000:3.0:1721219120.288427:0:17831:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x6a0b:0x0](ffff880136eb6d58), file ffff8800b6ddb500, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1721219120.288434:0:17831:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x6a0b:0x0](ffff880136eb6d58), intent=open|creat 00000002:00010000:3.0:1721219120.288453:0:17831:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f20e.sanity-pfl,[0x200000401:0x6a0c:0x0]) in obj [0x200000401:0x6a0b:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1721219120.288463:0:17831:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288497:0:17831:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288505:0:17831:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219120.288506:0:17831:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b840/0xe0b47d8ca5f729a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001310 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288528:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a0b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.288535:0:17831:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1721219120.288545:0:17831:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1721219120.288551:0:17831:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a8985f00 x1804827511244032/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1721219120.288559:0:17831:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219120.288572:0:17831:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511244032:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219120.288692:0:17831:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6cefc00 going to sleep for 90 seconds 00000100:00100000:3.0:1721219120.290443:0:17831:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985f00 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511244032:192.168.201.158@tcp:101:lfs.0 00010000:00010000:3.0:1721219120.290454:0:17831:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290480:0:17831:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290486:0:17831:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290493:0:17831:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290501:0:17831:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290510:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290517:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290523:0:17831:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219120.290532:0:17831:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a8985f00 x1804827511244032/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219211 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:3.0:1721219120.290542:0:17831:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a8985f00 x1804827511244032/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219211 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1721219120.290551:0:17831:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290569:0:17831:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 16 res 8589935617/27148 (0 0) 00000080:00200000:3.0:1721219120.290579:0:17831:0:(namei.c:1405:ll_create_it()) VFS Op:name=f20e.sanity-pfl, dir=[0x200000401:0x6a0b:0x0](ffff880136eb6d58), intent=open|creat 00000080:00200000:3.0:1721219120.290592:0:17831:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a0c:0x0](ffff8800b05eb718) 00000080:00200000:3.0:1721219120.290595:0:17831:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a0c:0x0], updating i_size 0 00000080:00200000:3.0:1721219120.290642:0:17831:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x6a0c:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1721219120.290647:0:17831:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x6a0c:0x0](ffff8800b05eb718) 00000080:00010000:3.0:1721219120.290649:0:17831:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a0c:0x0](ffff8800b05eb718) for lock 0xe0b47d8ca5f729b1 00000080:00200000:3.0:1721219120.290681:0:17831:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x6a0c:0x0](ffff8800b05eb718), flags 120501 00000002:00100000:3.0:1721219120.290693:0:17831:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a8985f00 x1804827511244032/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219211 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:3.0:1721219120.290731:0:17831:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f729b1 from it ffff8800b5f512a0 00010000:00010000:3.0:1721219120.290734:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290742:0:17831:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219120.290754:0:17831:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a0c:0x0](ffff8800b05eb718), inode mode 81a4 mask 40 00000080:00200000:3.0:1721219120.290793:0:17831:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a0c:0x0](ffff8800b05eb718), inode mode 81a4 mask 2 00000080:00200000:3.0:1721219120.290801:0:17831:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x6a0c:0x0](ffff8800b05eb718), xattr lov 00000002:00010000:3.0:1721219120.290810:0:17831:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x6a0c:0x0]) in obj [0x200000401:0x6a0b:0x0], intent: open flags 040000002 00010000:00010000:3.0:1721219120.290834:0:17831:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219120.290841:0:17831:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1721219120.290862:0:17831:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1721219120.290867:0:17831:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a8985a40 x1804827511244160/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1721219120.290874:0:17831:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219120.290887:0:17831:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985a40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511244160:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219120.290949:0:17831:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6ceff00 going to sleep for 90 seconds 00000100:00100000:2.0:1721219120.292031:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219120.292105:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459553600 00000100:00100000:3.0:1721219120.292151:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181489 00000100:00100000:3.0:1721219120.292158:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a86017c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27341:x1804827459553600:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219120.292206:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1721219120.292213:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a86017c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27341:x1804827459553600:12345-192.168.201.158@tcp:104: Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219120.292221:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181489 00010000:00010000:1.0:1721219120.292272:0:11546:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1721219120.292283:0:11546:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219120.292291:0:11546:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f87af40 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:1.0:1721219120.292292:0:11546:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219120.292297:0:11546:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219120.292301:0:11546:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219120.292314:0:11546:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x6a0c:0x0]: losing layout lock 00010000:00010000:1.0:1721219120.292332:0:11546:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219120.292336:0:11546:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219120.292359:0:11546:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219120.292364:0:11546:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87af40/0xe0b47d8ca5f729b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a0c:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001341 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219120.292375:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219120.292376:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219120.292377:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219120.292388:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721219120.292396:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511244224:192.168.201.158@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1721219120.293250:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511244224:192.168.201.158@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1721219120.838784:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219121.840781:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219122.842804:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219123.844911:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219124.346905:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244352:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219124.346959:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511244288:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219124.347035:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b179300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244480:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219124.347051:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511244416:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219124.349285:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244352:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1721219124.349298:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b179300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244480:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219124.349354:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511244288:192.168.201.158@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1721219124.349373:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511244416:192.168.201.158@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1721219124.846896:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219125.848805:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219126.850780:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219127.852918:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219128.854956:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219129.354829:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244608:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219129.354832:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b179300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511244544:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219129.354891:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244736:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219129.354892:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511244672:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219129.356242:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244608:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219129.356253:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244736:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219129.356261:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b179300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511244544:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219129.356271:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511244672:192.168.201.158@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1721219129.856857:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219130.858814:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219131.860852:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219132.862881:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219133.864990:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219134.362912:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244864:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219134.362937:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511244800:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219134.362982:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244992:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219134.362990:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511244928:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219134.364557:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244864:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219134.364568:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511244992:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219134.364597:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511244800:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219134.364605:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511244928:192.168.201.158@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1721219134.867064:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219135.868897:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219136.870766:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219137.872813:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219138.874853:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219139.370987:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511245120:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219139.371046:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511245056:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219139.371083:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511245248:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219139.371097:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511245184:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219139.373357:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511245056:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219139.373359:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511245120:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1721219139.373388:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511245184:192.168.201.158@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1721219139.373392:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511245248:192.168.201.158@tcp:400:kworker/u8:0.0 00010000:00010000:2.0:1721219139.877017:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219140.293284:0:17831:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985a40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511244160:192.168.201.158@tcp:101:lfs.0 00010000:00010000:3.0:1721219140.293300:0:17831:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293311:0:17831:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293323:0:17831:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293326:0:17831:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293330:0:17831:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293334:0:17831:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012f87a1c0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:3.0:1721219140.293336:0:17831:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293339:0:17831:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293343:0:17831:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293346:0:17831:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1721219140.293348:0:17831:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219140.293351:0:17831:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87a1c0/0xe0b47d8ca5f729b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a0b:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 17831 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219140.293377:0:17831:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8800a8985a40 x1804827511244160/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/600 e 0 to 0 dl 1721219211 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:3.0:1721219140.293397:0:17831:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:3.0:1721219140.293458:0:17831:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x6a0c:0x0](ffff8800b05eb718) 00000002:00100000:3.0:1721219140.293476:0:17831:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a8985f00 x1804827511244032/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219211 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:3.0:1721219140.293492:0:17831:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1721219140.293494:0:17831:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a8985a40 x1804827511245376/t0(0) o35->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1721219140.293506:0:17831:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985a40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511245376:192.168.201.158@tcp:35:lfs.0 00000100:00100000:3.0:1721219140.293549:0:17831:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6ceff00 going to sleep for 6 seconds 00000100:00100000:3.0:1721219140.294697:0:17831:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985a40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:17831:1804827511245376:192.168.201.158@tcp:35:lfs.0 00000002:00100000:3.0:1721219140.294707:0:17831:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a8985f00 x1804827511244032/t12884901997(12884901997) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219211 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000400:00000080:3.0:1721219140.676019:0:17979:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1721219140.676022:0:17979:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_20e: @@@@@@ FAIL: Create /mnt/lustre/d20e.sanity-pfl/f20e.sanity-pfl failed 00010000:00010000:1.0:1721219140.878791:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 789 lines, 789 kept, 0 dropped, 0 bad.