00010000:00010000:1.0F:1721219349.294787:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1721219349.706757:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8603440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511264704:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0F:1721219349.706788:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8602ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511264640:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219349.706817:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511264832:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219349.706819:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86076c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511264768:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219349.708030:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8602ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511264640:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219349.708039:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86076c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511264768:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219349.708053:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8603440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511264704:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219349.708060:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511264832:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219349.917330:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219349.917362:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219349.917383:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585984 00000100:00100000:2.0:1721219349.917405:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586112 00000100:00100000:2.0:1721219349.917412:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181504 00000100:00100000:2.0:1721219349.917417:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a86076c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14024:x1804827459585984:12345-192.168.201.158@tcp:104: 00000100:00100000:3.0:1721219349.917419:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181505 00000100:00100000:3.0:1721219349.917424:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8602ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14024:x1804827459586112:12345-192.168.201.158@tcp:104: 00010000:00010000:2.0:1721219349.917466:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219349.917469:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a86076c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14024:x1804827459585984:12345-192.168.201.158@tcp:104: Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219349.917474:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181504 00010000:00010000:3.0:1721219349.917477:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219349.917480:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8602ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14024:x1804827459586112:12345-192.168.201.158@tcp:104: Request processed in 57us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219349.917484:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181505 00010000:00010000:0.0F:1721219349.917490:0:4613:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1721219349.917502:0:4613:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00180a expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219349.917511:0:4613:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def3c0 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219349.917514:0:4613:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00180a expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219349.917520:0:4613:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00180a expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219349.917526:0:4613:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00180a expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219349.917531:0:4613:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1721219349.917542:0:4614:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1721219349.917546:0:4614:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001803 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219349.917552:0:4614:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9baeac0 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:1.0:1721219349.917553:0:4614:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001803 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219349.917557:0:4614:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001803 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219349.917560:0:4614:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001803 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1721219349.917562:0:4614:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219349.917564:0:4613:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00180a expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219349.917569:0:4613:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219349.917576:0:4614:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72ac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001803 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219349.917579:0:4614:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219349.917583:0:4613:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72ad0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00180a expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219349.917584:0:4614:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72ac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001803 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219349.917587:0:4614:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72ac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001803 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219349.917588:0:4613:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00180a expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219349.917603:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219349.917604:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219349.917605:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219349.917605:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219349.917606:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219349.917607:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219349.917617:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511264896:192.168.201.158@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1721219349.917617:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511264960:192.168.201.158@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1721219349.918435:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511264960:192.168.201.158@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219349.918436:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511264896:192.168.201.158@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1721219350.296998:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219351.298946:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1721219351.834707:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219351.834710:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 109 10000000:01000000:2.0:1721219351.834713:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219351.834742:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.834749:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.834755:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.834780:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86050c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265024:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.834840:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.836282:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86050c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265024:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219351.836302:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.836309:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219351.836344:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265088:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.836373:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.837491:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265088:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.837517:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265152:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.837554:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.838952:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265152:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219351.839171:0:22817:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22817:1804827511265216:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219351.839231:0:22817:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5300 going to sleep for 6 seconds 00000100:00100000:1.0:1721219351.840685:0:22817:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22817:1804827511265216:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219351.840704:0:22817:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219351.840710:0:22817:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219351.840711:0:22817:0:(obd_config.c:1460:class_process_config()) marker 70 (0x1) lustre-clilov rem lustre.test_22c.lustre-OST0000_UUID 00000020:01000000:1.0:1721219351.840714:0:22817:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219351.840716:0:22817:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1721219351.840724:0:22817:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0000_UUID removed from test_22c 00000100:00100000:1.0:1721219351.840735:0:22817:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22817:1804827511265280:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219351.840767:0:22817:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5300 going to sleep for 6 seconds 00000100:00100000:1.0:1721219351.842030:0:22817:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22817:1804827511265280:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219351.842046:0:22817:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219351.842049:0:22817:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219351.842050:0:22817:0:(obd_config.c:1460:class_process_config()) marker 70 (0x2) lustre-clilov rem lustre.test_22c.lustre-OST0000_UUID 00000040:00080000:1.0:1721219351.842053:0:22817:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 112 count 111 00000020:01000000:0.0:1721219351.842100:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 109-111 (rc=0) 10000000:01000000:0.0:1721219351.842117:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219351.842120:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.842127:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219351.842134:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219351.842135:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219351.842137:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219351.842148:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.842154:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.842165:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219351.842176:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265344:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.842224:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.843205:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265344:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219351.843213:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.843218:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219351.843239:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265408:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.843261:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.844285:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265408:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219351.844300:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219351.844303:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.844308:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.226633:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219352.226702:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219352.226733:0:4606:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1721219352.226736:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588672 00000100:00100000:2.0:1721219352.226748:0:4606:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588736 00000100:00100000:2.0:1721219352.226763:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181506 00000100:00100000:2.0:1721219352.226767:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8985580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14099:x1804827459588672:12345-192.168.201.158@tcp:104: 00000100:00100000:3.0:1721219352.226768:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181507 00000100:00100000:3.0:1721219352.226771:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8beb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14099:x1804827459588736:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219352.226816:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219352.226819:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8beb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14099:x1804827459588736:12345-192.168.201.158@tcp:104: Request processed in 48us (118us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219352.226821:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219352.226824:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181507 00000100:00100000:2.0:1721219352.226824:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8985580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14099:x1804827459588672:12345-192.168.201.158@tcp:104: Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219352.226829:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181506 00010000:00010000:0.0:1721219352.226845:0:9881:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1721219352.226851:0:9881:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.226857:0:11574:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1721219352.226859:0:11574:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.226861:0:9881:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9bacb40 already unused, calling callback (ffffffffa030c5c0) 00010000:00010000:2.0:1721219352.226865:0:11574:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def3c0 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:2.0:1721219352.226867:0:11574:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219352.226870:0:9881:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.226872:0:11574:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219352.226876:0:11574:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.226876:0:9881:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219352.226878:0:11574:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1721219352.226881:0:9881:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219352.226886:0:9881:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219352.226909:0:11574:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.226910:0:9881:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.226915:0:9881:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1721219352.226920:0:11574:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219352.226930:0:9881:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.226933:0:11574:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.226935:0:9881:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00193e expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.226936:0:11574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8def3c0/0xe0b47d8ca5f72afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001945 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.226947:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219352.226948:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219352.226948:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219352.226951:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219352.226952:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219352.226953:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219352.226958:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721219352.226962:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511265472:192.168.201.158@tcp:103:ldlm_bl_07.0 00000100:00100000:0.0:1721219352.226968:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511265536:192.168.201.158@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1721219352.227808:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511265536:192.168.201.158@tcp:103:ldlm_bl_03.0 00000100:00100000:2.0:1721219352.227820:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511265472:192.168.201.158@tcp:103:ldlm_bl_07.0 00010000:00010000:1.0:1721219352.300801:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219353.302764:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1721219353.504754:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219353.504758:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 112 10000000:01000000:2.0:1721219353.504762:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219353.504789:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.504795:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.504803:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219353.504819:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265600:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.504878:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.505973:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265600:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219353.505985:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.505997:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219353.506034:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265664:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.506061:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.506888:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265664:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.506912:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265728:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.506948:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.507993:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265728:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219353.508185:0:22836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8984740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22836:1804827511265792:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:3.0:1721219353.508218:0:22836:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940240 going to sleep for 6 seconds 00000100:00100000:0.0:1721219353.509232:0:22836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8984740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22836:1804827511265792:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:0.0:1721219353.509255:0:22836:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1721219353.509261:0:22836:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1721219353.509263:0:22836:0:(obd_config.c:1460:class_process_config()) marker 72 (0x1) lustre-clilov rem lustre.test_22c.lustre-OST0001_UUID 00000020:01000000:0.0:1721219353.509271:0:22836:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce022, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:0.0:1721219353.509273:0:22836:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1721219353.509282:0:22836:0:(lov_pool.c:476:lov_pool_remove()) lustre-OST0001_UUID removed from test_22c 00000100:00100000:0.0:1721219353.509298:0:22836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22836:1804827511265856:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:0.0:1721219353.509337:0:22836:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219353.510253:0:22836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22836:1804827511265856:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:0.0:1721219353.510271:0:22836:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1721219353.510274:0:22836:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1721219353.510275:0:22836:0:(obd_config.c:1460:class_process_config()) marker 72 (0x2) lustre-clilov rem lustre.test_22c.lustre-OST0001_UUID 00000040:00080000:0.0:1721219353.510278:0:22836:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 115 count 114 00000020:01000000:2.0:1721219353.510327:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 112-114 (rc=0) 10000000:01000000:2.0:1721219353.510340:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219353.510343:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.510349:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219353.510353:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1721219353.510354:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:2.0:1721219353.510356:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1721219353.510365:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.510368:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.510372:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219353.510385:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265920:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.510405:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.511133:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265920:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219353.511142:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.511147:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219353.511187:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265984:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.511221:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.512081:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511265984:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1721219353.512095:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1721219353.512098:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.512103:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219353.782463:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219353.782533:0:1829:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219353.782580:0:4606:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591488 00000100:00100000:2.0:1721219353.782584:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591552 00000100:00100000:2.0:1721219353.782623:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181508 00000100:00100000:2.0:1721219353.782630:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8984280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14240:x1804827459591488:12345-192.168.201.158@tcp:104: 00000100:00100000:3.0:1721219353.782636:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181509 00000100:00100000:3.0:1721219353.782644:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8983900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14240:x1804827459591552:12345-192.168.201.158@tcp:104: 00010000:00010000:2.0:1721219353.782736:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219353.782742:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8984280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14240:x1804827459591488:12345-192.168.201.158@tcp:104: Request processed in 113us (285us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219353.782743:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219353.782751:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8983900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:14240:x1804827459591552:12345-192.168.201.158@tcp:104: Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219353.782761:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181509 00000100:00100000:2.0:1721219353.782767:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181508 00010000:00010000:0.0:1721219353.782782:0:11571:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1721219353.782790:0:11571:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.782802:0:11571:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9bacb40 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219353.782806:0:11571:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.782813:0:11571:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219353.782819:0:11571:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219353.782824:0:11571:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1721219353.782829:0:4614:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1721219353.782837:0:4614:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.782849:0:4614:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9badd40 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:1.0:1721219353.782851:0:4614:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.782858:0:4614:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219353.782864:0:4614:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.782870:0:11571:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.782875:0:11571:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1721219353.782877:0:4614:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219353.782892:0:11571:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.782899:0:4614:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.782905:0:4614:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219353.782906:0:11571:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9bacb40/0xe0b47d8ca5f72b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019bc expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.782913:0:4614:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.782918:0:4614:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019b5 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.782930:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219353.782931:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219353.782933:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219353.782940:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219353.782941:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219353.782943:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219353.782950:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511266048:192.168.201.158@tcp:103:ldlm_bl_05.0 00000100:00100000:1.0:1721219353.782956:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511266112:192.168.201.158@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1721219353.784248:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511266048:192.168.201.158@tcp:103:ldlm_bl_05.0 00000100:00100000:1.0:1721219353.784256:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511266112:192.168.201.158@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1721219354.304837:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219354.714745:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86076c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511266240:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219354.714782:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1721219354.714785:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511266176:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219354.714794:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8602ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511266304:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219354.715807:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511266176:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219354.715814:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8602ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511266304:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219354.715818:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86076c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511266240:192.168.201.158@tcp:400:kworker/u8:2.0 10000000:01000000:3.0:1721219354.986756:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1721219354.986762:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 115 10000000:01000000:3.0:1721219354.986767:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1721219354.986795:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.986805:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.986815:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219354.986832:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266368:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1721219354.986887:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940000 going to sleep for 6 seconds 00000100:00100000:3.0:1721219354.988506:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266368:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219354.988522:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.988531:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219354.988577:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266432:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219354.988619:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940000 going to sleep for 6 seconds 00000100:00100000:3.0:1721219354.990071:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266432:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219354.990113:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266496:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219354.990212:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940000 going to sleep for 6 seconds 00000100:00100000:3.0:1721219354.992047:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266496:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219354.992366:0:22846:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22846:1804827511266560:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:3.0:1721219354.992421:0:22846:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940000 going to sleep for 6 seconds 00000100:00100000:3.0:1721219354.994330:0:22846:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22846:1804827511266560:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:3.0:1721219354.994360:0:22846:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1721219354.994368:0:22846:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1721219354.994370:0:22846:0:(obd_config.c:1460:class_process_config()) marker 74 (0x1) lustre-clilov del lustre.test_22c 00000020:01000000:3.0:1721219354.994375:0:22846:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce023, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:3.0:1721219354.994377:0:22846:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1721219354.994433:0:22846:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22846:1804827511266624:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:3.0:1721219354.994473:0:22846:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940000 going to sleep for 6 seconds 00000100:00100000:3.0:1721219354.996066:0:22846:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:22846:1804827511266624:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:3.0:1721219354.996099:0:22846:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1721219354.996104:0:22846:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1721219354.996105:0:22846:0:(obd_config.c:1460:class_process_config()) marker 74 (0x2) lustre-clilov del lustre.test_22c 00000040:00080000:3.0:1721219354.996109:0:22846:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 118 count 117 00000020:01000000:0.0:1721219354.996224:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 115-117 (rc=0) 10000000:01000000:0.0:1721219354.996248:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219354.996253:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.996262:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219354.996270:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219354.996272:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219354.996274:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219354.996291:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.996296:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.996302:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219354.996316:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266688:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219354.996372:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0d80 going to sleep for 6 seconds 00000100:00100000:0.0:1721219354.997526:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266688:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219354.997540:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.997550:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219354.997596:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266752:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219354.997649:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0d80 going to sleep for 6 seconds 00000100:00100000:0.0:1721219354.999044:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511266752:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219354.999069:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219354.999073:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.999081:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219355.306891:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219356.308804:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219357.310850:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219358.312786:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1721219358.360429:0:23134:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219358.360432:0:23134:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 22d: out of/low on space + failed to repeat + forced extension ========================================================== 08:29:17 (1721219357) 00000080:00200000:0.0:1721219358.418780:0:22998:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219358.418795:0:22998:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219358.418808:0:22998:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.418819:0:22998:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219358.418828:0:22998:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219358.418834:0:22998:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219358.418840:0:22998:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012f80faf8 00010000:00010000:0.0:1721219358.418842:0:22998:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.418849:0:22998:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219358.418861:0:22998:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219358.418868:0:22998:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1 00000080:00200000:0.0:1721219358.418872:0:22998:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=getattr 00000002:00010000:0.0:1721219358.418878:0:22998:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22d.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219358.418910:0:22998:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.418916:0:22998:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.418924:0:22998:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219358.418943:0:22998:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:22998:1804827511266816:192.168.201.158@tcp:101:bash.0 00000100:00100000:0.0:1721219358.419008:0:22998:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0540 going to sleep for 90 seconds 00000100:00100000:0.0:1721219358.420699:0:22998:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:22998:1804827511266816:192.168.201.158@tcp:101:bash.0 00010000:00010000:0.0:1721219358.420708:0:22998:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420716:0:22998:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420725:0:22998:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420731:0:22998:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420736:0:22998:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420742:0:22998:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def3c0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219358.420745:0:22998:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420751:0:22998:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420757:0:22998:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420762:0:22998:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219358.420765:0:22998:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420770:0:22998:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219358.420780:0:22998:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a9282ac0 x1804827511266816/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219449 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:0.0:1721219358.420796:0:22998:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1721219358.420848:0:22998:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219358.420854:0:22998:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219358.420859:0:22998:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:0.0:1721219358.420872:0:22998:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420878:0:22998:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.420884:0:22998:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219358.420894:0:22998:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:22998:1804827511266880:192.168.201.158@tcp:101:bash.0 00000100:00100000:0.0:1721219358.420923:0:22998:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0540 going to sleep for 90 seconds 00000100:00100000:0.0:1721219358.422109:0:22998:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:22998:1804827511266880:192.168.201.158@tcp:101:bash.0 00010000:00010000:0.0:1721219358.422128:0:22998:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.422135:0:22998:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.422143:0:22998:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.422151:0:22998:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.422157:0:22998:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.422175:0:22998:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.422181:0:22998:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219358.422188:0:22998:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a9282ac0 x1804827511266880/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 576/688 e 0 to 0 dl 1721219449 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:0.0:1721219358.422196:0:22998:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.422203:0:22998:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1721219358.422216:0:22998:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 13824 00000080:00010000:0.0:1721219358.422220:0:22998:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f72b24 00000080:00010000:0.0:1721219358.422223:0:22998:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219358.422225:0:22998:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72b24 from it ffff88012f80fcf8 00010000:00010000:0.0:1721219358.422226:0:22998:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219358.422232:0:22998:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219358.424240:0:23158:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219358.424246:0:23158:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219358.424251:0:23158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424257:0:23158:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219358.424262:0:23158:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219358.424265:0:23158:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219358.424268:0:23158:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8703b58 00010000:00010000:1.0:1721219358.424269:0:23158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424273:0:23158:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219358.424278:0:23158:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:1.0:1721219358.424283:0:23158:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1536 00000080:00200000:1.0:1721219358.424284:0:23158:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219358.424286:0:23158:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219358.424288:0:23158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424291:0:23158:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219358.424295:0:23158:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219358.424296:0:23158:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219358.424297:0:23158:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8703bf8 00010000:00010000:1.0:1721219358.424298:0:23158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424300:0:23158:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219358.424303:0:23158:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:1.0:1721219358.424305:0:23158:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:1.0:1721219358.424310:0:23158:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1721219358.424312:0:23158:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424315:0:23158:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1721219358.424318:0:23158:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:1.0:1721219358.424319:0:23158:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:1.0:1721219358.424320:0:23158:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8703da0 00010000:00010000:1.0:1721219358.424321:0:23158:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424323:0:23158:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1721219358.424327:0:23158:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:1.0:1721219358.424328:0:23158:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8) 00800000:00000004:1.0:1721219358.424336:0:23158:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800af021000: age 1462, max_age 0 00000100:00100000:1.0:1721219358.424365:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721219358.424373:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511266944:192.168.201.158@tcp:41:mkdir.0 00010000:00010000:1.0:1721219358.424409:0:23158:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424418:0:23158:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424433:0:23158:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219358.424443:0:23158:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219358.424444:0:23158:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001a56 expref: -99 pid: 22998 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1721219358.424452:0:23158:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1721219358.424456:0:23158:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a862bdc0 x1804827511267072/t0(0) o36->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1721219358.424463:0:23158:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862bdc0 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:23158:1804827511267072:192.168.201.158@tcp:36:mkdir.0 00000100:00100000:1.0:1721219358.424485:0:23158:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5600 going to sleep for 90 seconds 00000100:00100000:1.0:1721219358.425224:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511266944:192.168.201.158@tcp:41:mkdir.0 00000100:00100000:1.0:1721219358.426340:0:23158:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862bdc0 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:23158:1804827511267072:192.168.201.158@tcp:36:mkdir.0 00000080:00200000:1.0:1721219358.426356:0:23158:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a19:0x0](ffff8800b065ce58) 00000080:00200000:1.0:1721219358.426359:0:23158:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a19:0x0], updating i_size 512 00010000:00010000:2.0:1721219359.314836:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219359.722851:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267200:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219359.722851:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511267136:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219359.722907:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267328:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219359.722908:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511267264:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219359.724545:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267200:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219359.724552:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267328:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219359.724560:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511267136:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219359.724568:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511267264:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1721219360.316814:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219361.318910:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219362.320883:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219363.322836:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219364.324859:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219364.730807:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267456:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219364.730843:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511267392:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219364.730873:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267584:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219364.730875:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511267520:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219364.732431:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511267520:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219364.732454:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511267392:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219364.732460:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267456:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219364.732470:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267584:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1721219365.326814:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219366.328838:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219367.330887:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219368.017796:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219368.017837:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219368.017863:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596416 00000100:00100000:2.0:1721219368.017896:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596544 00000100:00100000:3.0:1721219368.017905:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181510 00000100:00100000:3.0:1721219368.017911:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8602140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:15116:x1804827459596416:12345-192.168.201.158@tcp:104: 00000100:00100000:2.0:1721219368.017912:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181511 00000100:00100000:2.0:1721219368.017916:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8606d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:15116:x1804827459596544:12345-192.168.201.158@tcp:104: 00010000:00010000:2.0:1721219368.017982:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219368.017986:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8606d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:15116:x1804827459596544:12345-192.168.201.158@tcp:104: Request processed in 70us (149us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219368.017990:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219368.017991:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181511 00000100:00100000:3.0:1721219368.017994:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8602140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:15116:x1804827459596416:12345-192.168.201.158@tcp:104: Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219368.017999:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181510 00010000:00010000:0.0:1721219368.018016:0:11573:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1721219368.018023:0:11574:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219368.018023:0:11573:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.018026:0:11574:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.018034:0:11573:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8030b40 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219368.018038:0:11573:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.018043:0:11574:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dec000 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:3.0:1721219368.018045:0:11574:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.018050:0:11574:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.018051:0:11573:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219368.018054:0:11574:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219368.018057:0:11574:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1721219368.018057:0:11573:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219368.018062:0:11573:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219368.018094:0:11574:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.018095:0:11573:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.018098:0:11574:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219368.018101:0:11573:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219368.018112:0:11574:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.018115:0:11573:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.018116:0:11574:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019d1 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.018121:0:11573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8030b40/0xe0b47d8ca5f72b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ca expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.018126:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219368.018127:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219368.018128:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219368.018138:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219368.018139:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511267648:192.168.201.158@tcp:103:ldlm_bl_07.0 00010000:00010000:0.0:1721219368.018139:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219368.018141:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219368.018148:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721219368.018158:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511267712:192.168.201.158@tcp:103:ldlm_bl_06.0 00000100:00100000:3.0:1721219368.019157:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511267648:192.168.201.158@tcp:103:ldlm_bl_07.0 00000100:00100000:0.0:1721219368.019199:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511267712:192.168.201.158@tcp:103:ldlm_bl_06.0 00010000:00010000:2.0:1721219368.332839:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219369.334862:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219369.738824:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8982ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511267840:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219369.738872:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511267776:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219369.738916:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8987200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511267968:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219369.738926:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8984740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267904:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219369.740753:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8983dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1837:1804827511267776:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219369.740765:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8984740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511267904:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219369.740785:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8982ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511267840:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219369.740807:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8987200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511267968:192.168.201.158@tcp:400:kworker/u8:2.0 10000000:01000000:2.0:1721219369.782776:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219369.782779:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 118 10000000:01000000:2.0:1721219369.782782:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219369.782803:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219369.782813:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219369.782819:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219369.782829:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8600980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268032:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219369.782861:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219369.784096:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8600980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268032:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219369.784109:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219369.784115:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219369.784156:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268096:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219369.784185:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219369.785310:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268096:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219369.785333:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268160:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219369.785368:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219369.786743:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268160:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219369.786956:0:23346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:23346:1804827511268224:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219369.787002:0:23346:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5180 going to sleep for 6 seconds 00000100:00100000:1.0:1721219369.788362:0:23346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:23346:1804827511268224:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219369.788381:0:23346:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219369.788387:0:23346:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219369.788388:0:23346:0:(obd_config.c:1460:class_process_config()) marker 76 (0x1) lustre-clilov new lustre.test_22d 00000020:01000000:1.0:1721219369.788391:0:23346:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:1.0:1721219369.788392:0:23346:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1721219369.788409:0:23346:0:(lov_pool.c:313:lov_pool_new()) test_22d is pool #2 00000100:00100000:1.0:1721219369.788420:0:23346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:23346:1804827511268288:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219369.788448:0:23346:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5240 going to sleep for 6 seconds 00000100:00100000:1.0:1721219369.789934:0:23346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:23346:1804827511268288:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:1.0:1721219369.789954:0:23346:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219369.789958:0:23346:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219369.789959:0:23346:0:(obd_config.c:1460:class_process_config()) marker 76 (0x2) lustre-clilov new lustre.test_22d 00000040:00080000:1.0:1721219369.789962:0:23346:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 121 count 120 00000020:01000000:0.0:1721219369.790005:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 118-120 (rc=0) 10000000:01000000:0.0:1721219369.790019:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219369.790023:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219369.790028:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219369.790033:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219369.790034:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:0.0:1721219369.790035:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219369.790045:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219369.790048:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219369.790052:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219369.790059:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268352:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219369.790090:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219369.791121:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268352:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219369.791130:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219369.791135:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219369.791156:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268416:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219369.791181:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219369.792334:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268416:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219369.792350:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219369.792353:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219369.792360:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.336875:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219370.696970:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219370.697032:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219370.697072:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599680 00000100:00100000:3.0:1721219370.697109:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599744 00000100:00100000:3.0:1721219370.697122:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181512 00000100:00100000:3.0:1721219370.697128:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8987200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:15354:x1804827459599680:12345-192.168.201.158@tcp:104: 00000100:00100000:2.0:1721219370.697133:0:4606:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181513 00000100:00100000:2.0:1721219370.697143:0:4606:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8982ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:15354:x1804827459599744:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219370.697207:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219370.697213:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8987200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+4:15354:x1804827459599680:12345-192.168.201.158@tcp:104: Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219370.697221:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181512 00010000:00010000:2.0:1721219370.697226:0:4606:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219370.697233:0:4606:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8982ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+3:15354:x1804827459599744:12345-192.168.201.158@tcp:104: Request processed in 92us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.697240:0:4606:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181513 00010000:00010000:0.0:1721219370.697293:0:11571:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1721219370.697301:0:11571:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.697316:0:11571:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dec000 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:0.0:1721219370.697319:0:11571:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219370.697328:0:4614:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219370.697328:0:11571:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219370.697336:0:4614:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219370.697346:0:4614:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9badd40 already unused, calling callback (ffffffffa030c5c0) 10000000:00010000:1.0:1721219370.697349:0:4614:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219370.697351:0:11571:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219370.697356:0:4614:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219370.697356:0:11571:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1721219370.697361:0:4614:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1721219370.697366:0:4614:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1721219370.697414:0:4614:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.697414:0:11571:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.697420:0:11571:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219370.697421:0:4614:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219370.697440:0:4614:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.697446:0:11571:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219370.697447:0:4614:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a9badd40/0xe0b47d8ca5f72b2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a72 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.697453:0:11571:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a8dec000/0xe0b47d8ca5f72b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a79 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.697472:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219370.697473:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219370.697476:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219370.697489:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219370.697491:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219370.697493:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219370.697498:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511268544:192.168.201.158@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219370.697508:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511268480:192.168.201.158@tcp:103:ldlm_bl_05.0 00000100:00100000:1.0:1721219370.698975:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511268480:192.168.201.158@tcp:103:ldlm_bl_05.0 00000100:00100000:0.0:1721219370.699008:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511268544:192.168.201.158@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1721219371.338846:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219372.340890:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1721219372.616750:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219372.616756:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800af021000 from 121 10000000:01000000:2.0:1721219372.616759:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219372.616792:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219372.616800:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219372.616807:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219372.616825:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268608:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219372.616933:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162000 going to sleep for 6 seconds 00000100:00100000:2.0:1721219372.618263:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268608:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219372.618276:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b4b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219372.618283:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001b4b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219372.618324:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268672:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219372.618350:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162000 going to sleep for 6 seconds 00000100:00100000:2.0:1721219372.619531:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268672:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219372.619558:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268736:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219372.619596:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162000 going to sleep for 6 seconds 00000100:00100000:2.0:1721219372.620934:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268736:192.168.201.158@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219372.621126:0:23412:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89817c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:23412:1804827511268800:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:3.0:1721219372.621163:0:23412:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219372.622598:0:23412:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89817c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:23412:1804827511268800:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:0.0:1721219372.622623:0:23412:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1721219372.622630:0:23412:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1721219372.622632:0:23412:0:(obd_config.c:1460:class_process_config()) marker 78 (0x1) lustre-clilov add lustre.test_22d.lustre-OST0000_UUID 00000020:01000000:0.0:1721219372.622637:0:23412:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800af021000 00000020:00000080:0.0:1721219372.622639:0:23412:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1721219372.622648:0:23412:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_22d as member 1 00000100:00100000:0.0:1721219372.622686:0:23412:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:23412:1804827511268864:192.168.201.158@tcp:502:llog_process_th.0 00000100:00100000:0.0:1721219372.622734:0:23412:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219372.624380:0:23412:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:23412:1804827511268864:192.168.201.158@tcp:502:llog_process_th.0 00000020:01000000:0.0:1721219372.624413:0:23412:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1721219372.624418:0:23412:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1721219372.624420:0:23412:0:(obd_config.c:1460:class_process_config()) marker 78 (0x2) lustre-clilov add lustre.test_22d.lustre-OST0000_UUID 00000040:00080000:0.0:1721219372.624424:0:23412:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 124 count 123 00000020:01000000:2.0:1721219372.624550:0:4616:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 121-123 (rc=0) 10000000:01000000:2.0:1721219372.624573:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219372.624578:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72b39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b4b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219372.624588:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9baeac0/0xe0b47d8ca5f72b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b4b expref: -99 pid: 4616 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219372.624597:0:4616:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1721219372.624599:0:4616:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800ab4a8000 from 1 10000000:01000000:2.0:1721219372.624601:0:4616:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1721219372.624618:0:4616:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219372.624633:0:4616:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219372.624641:0:4616:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219372.624685:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268928:192.168.201.158@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219372.624738:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162000 going to sleep for 6 seconds 00000100:00100000:2.0:1721219372.626314:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268928:192.168.201.158@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219372.626330:0:4616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b52 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219372.626341:0:4616:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001b52 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219372.626382:0:4616:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268992:192.168.201.158@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219372.626434:0:4616:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162000 going to sleep for 6 seconds 00000100:00100000:2.0:1721219372.627716:0:4616:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8605a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:4616:1804827511268992:192.168.201.158@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1721219372.627731:0:4616:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1721219372.627734:0:4616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b52 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219372.627740:0:4616:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a9bad680/0xe0b47d8ca5f72b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b52 expref: -99 pid: 4616 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219373.067320:0:23423:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219373.067340:0:23423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219373.067356:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219373.067371:0:23423:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219373.067383:0:23423:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219373.067386:0:23423:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219373.067392:0:23423:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8703af8 00010000:00010000:3.0:1721219373.067395:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219373.067408:0:23423:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219373.067424:0:23423:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:3.0:1721219373.067433:0:23423:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=16 00000080:00200000:3.0:1721219373.067437:0:23423:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22d.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=0 00000002:00010000:3.0:1721219373.067445:0:23423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22d.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219373.067483:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219373.067490:0:23423:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219373.067499:0:23423:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219373.067536:0:23423:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8985580 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269056:192.168.201.158@tcp:101:lfs.0 00000100:00100000:3.0:1721219373.067607:0:23423:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8940cc0 going to sleep for 90 seconds 00000100:00100000:0.0:1721219373.070332:0:23423:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8985580 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269056:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219373.070345:0:23423:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070356:0:23423:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070360:0:23423:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070368:0:23423:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070374:0:23423:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070381:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070385:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070398:0:23423:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219373.070406:0:23423:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a8985580 x1804827511269056/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219464 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1721219373.070414:0:23423:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070420:0:23423:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589935617/27161 (0 0) 00000080:00200000:0.0:1721219373.070435:0:23423:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a19:0x0], updating i_size 11776 00000080:00200000:0.0:1721219373.070437:0:23423:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6a19:0x0](ffff8800b065ce58): rc = 0 00000080:00010000:0.0:1721219373.070442:0:23423:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a19:0x0](ffff8800b065ce58) for lock 0xe0b47d8ca5f72b47 00000080:00010000:0.0:1721219373.070448:0:23423:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x6a19:0x0](ffff8800b065ce58) 00000080:00010000:0.0:1721219373.070450:0:23423:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72b47 from it ffff8800a8703a70 00010000:00010000:0.0:1721219373.070451:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070456:0:23423:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219373.070472:0:23423:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a19:0x0](ffff8800b065ce58), inode mode 41ed mask 1 00000080:00200000:0.0:1721219373.070478:0:23423:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x6a19:0x0](ffff8800b065ce58), flags=0 00000080:00200000:0.0:1721219373.070480:0:23423:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x6a19:0x0](ffff8800b065ce58), intent=getattr 00000002:00010000:0.0:1721219373.070486:0:23423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22d.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x6a19:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219373.070504:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070517:0:23423:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.070523:0:23423:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219373.070533:0:23423:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269120:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219373.070573:0:23423:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0000 going to sleep for 90 seconds 00000100:00100000:0.0:1721219373.072512:0:23423:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269120:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219373.072525:0:23423:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072536:0:23423:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072543:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072549:0:23423:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072557:0:23423:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072563:0:23423:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dec000 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219373.072567:0:23423:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072587:0:23423:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072595:0:23423:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072600:0:23423:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219373.072604:0:23423:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072609:0:23423:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219373.072622:0:23423:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a9282140 x1804827511269120/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219464 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:0.0:1721219373.072643:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072651:0:23423:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219373.072688:0:23423:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72b47 from it ffff8800a87039f0 00010000:00010000:0.0:1721219373.072690:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072696:0:23423:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219373.072743:0:23423:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219373.072758:0:23423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219373.072764:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072772:0:23423:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219373.072779:0:23423:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219373.072781:0:23423:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219373.072785:0:23423:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a8703bb0 00010000:00010000:0.0:1721219373.072786:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072792:0:23423:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219373.072799:0:23423:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219373.072805:0:23423:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d22d.sanity-pfl, flags=17 00000080:00200000:0.0:1721219373.072807:0:23423:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a19:0x0](ffff8800b065ce58), inode mode 41ed mask 1 00000080:00200000:0.0:1721219373.072813:0:23423:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f22d.sanity-pfl, flags=769 00000080:00200000:0.0:1721219373.072815:0:23423:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a19:0x0](ffff8800b065ce58), inode mode 41ed mask 3 00000080:00200000:0.0:1721219373.072818:0:23423:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x6a19:0x0](ffff8800b065ce58), file ffff88012a437080, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1721219373.072825:0:23423:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x6a19:0x0](ffff8800b065ce58), intent=open|creat 00000002:00010000:0.0:1721219373.072861:0:23423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22d.sanity-pfl,[0x200000401:0x6a1a:0x0]) in obj [0x200000401:0x6a19:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1721219373.072871:0:23423:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072907:0:23423:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072919:0:23423:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219373.072920:0:23423:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8031d40/0xe0b47d8ca5f72b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001b6e expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072944:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.072950:0:23423:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219373.072962:0:23423:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1721219373.072970:0:23423:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9282140 x1804827511269248/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1721219373.072982:0:23423:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219373.073014:0:23423:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269248:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219373.073123:0:23423:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0000 going to sleep for 90 seconds 00000100:00100000:0.0:1721219373.075564:0:23423:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9282140 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269248:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219373.075575:0:23423:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075588:0:23423:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075593:0:23423:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075609:0:23423:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075615:0:23423:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075622:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075626:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075631:0:23423:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219373.075638:0:23423:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a9282140 x1804827511269248/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219464 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1721219373.075646:0:23423:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9282140 x1804827511269248/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219464 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1721219373.075686:0:23423:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075692:0:23423:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 16 res 8589935617/27162 (0 0) 00000080:00200000:0.0:1721219373.075701:0:23423:0:(namei.c:1405:ll_create_it()) VFS Op:name=f22d.sanity-pfl, dir=[0x200000401:0x6a19:0x0](ffff8800b065ce58), intent=open|creat 00000080:00200000:0.0:1721219373.075714:0:23423:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a1a:0x0](ffff8800b061c698) 00000080:00200000:0.0:1721219373.075718:0:23423:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a1a:0x0], updating i_size 0 00000080:00200000:0.0:1721219373.075744:0:23423:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x6a1a:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1721219373.075753:0:23423:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x6a1a:0x0](ffff8800b061c698) 00000080:00010000:0.0:1721219373.075755:0:23423:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a1a:0x0](ffff8800b061c698) for lock 0xe0b47d8ca5f72b55 00000080:00200000:0.0:1721219373.075763:0:23423:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x6a1a:0x0](ffff8800b061c698), flags 120501 00000002:00100000:0.0:1721219373.075773:0:23423:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a9282140 x1804827511269248/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219464 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:0.0:1721219373.075807:0:23423:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72b55 from it ffff8800a9240360 00010000:00010000:0.0:1721219373.075810:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075816:0:23423:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219373.075825:0:23423:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a1a:0x0](ffff8800b061c698), inode mode 81a4 mask 40 00000080:00200000:0.0:1721219373.075889:0:23423:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a1a:0x0](ffff8800b061c698), inode mode 81a4 mask 2 00000080:00200000:0.0:1721219373.075897:0:23423:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x6a1a:0x0](ffff8800b061c698), xattr lov 00000002:00010000:0.0:1721219373.075906:0:23423:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x6a1a:0x0]) in obj [0x200000401:0x6a19:0x0], intent: open flags 040000002 00010000:00010000:0.0:1721219373.075930:0:23423:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.075935:0:23423:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219373.075942:0:23423:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1721219373.075946:0:23423:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9280e40 x1804827511269376/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1721219373.075952:0:23423:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219373.075962:0:23423:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9280e40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269376:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219373.076015:0:23423:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0000 going to sleep for 90 seconds 00000100:00100000:2.0:1721219373.077374:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1721219373.077507:0:11164:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1721219373.077528:0:11164:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601664 00000100:00100000:3.0:1721219373.077580:0:11164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181514 00000100:00100000:3.0:1721219373.077587:0:11164:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:30055:x1804827459601664:12345-192.168.201.158@tcp:104: 00010000:00010000:3.0:1721219373.077643:0:11164:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1721219373.077649:0:11164:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:30055:x1804827459601664:12345-192.168.201.158@tcp:104: Request processed in 62us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219373.077681:0:11164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181514 00010000:00010000:0.0:1721219373.077737:0:9881:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219373.077744:0:9881:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.077756:0:9881:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8deeac0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219373.077759:0:9881:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.077766:0:9881:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.077774:0:9881:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219373.077791:0:9881:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x6a1a:0x0]: losing layout lock 00010000:00010000:0.0:1721219373.077818:0:9881:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.077824:0:9881:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219373.077881:0:9881:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.077889:0:9881:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e001b9f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219373.077904:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219373.077905:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219373.077907:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219373.077924:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721219373.077946:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511269440:192.168.201.158@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1721219373.079279:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9287200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511269440:192.168.201.158@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1721219373.079399:0:23423:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9280e40 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269376:192.168.201.158@tcp:101:lfs.0 00010000:00010000:1.0:1721219373.079410:0:23423:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079419:0:23423:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079425:0:23423:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079430:0:23423:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079435:0:23423:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079440:0:23423:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def600 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:1.0:1721219373.079441:0:23423:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079446:0:23423:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079457:0:23423:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079462:0:23423:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1721219373.079464:0:23423:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.079468:0:23423:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def600/0xe0b47d8ca5f72b5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1721219373.079481:0:23423:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8800a9280e40 x1804827511269376/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/600 e 0 to 0 dl 1721219464 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1721219373.079492:0:23423:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:1.0:1721219373.079538:0:23423:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x6a1a:0x0](ffff8800b061c698) 00000002:00100000:1.0:1721219373.079556:0:23423:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a9282140 x1804827511269248/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219464 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:1.0:1721219373.079571:0:23423:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1721219373.079575:0:23423:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a86284c0 x1804827511269568/t0(0) o35->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1721219373.079586:0:23423:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86284c0 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269568:192.168.201.158@tcp:35:lfs.0 00000100:00100000:1.0:1721219373.079629:0:23423:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012d7e5a80 going to sleep for 6 seconds 00000100:00100000:1.0:1721219373.081282:0:23423:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86284c0 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:23423:1804827511269568:192.168.201.158@tcp:35:lfs.0 00000002:00100000:1.0:1721219373.081302:0:23423:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9282140 x1804827511269248/t12884902032(12884902032) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219464 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00010000:00010000:1.0:1721219373.342747:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1721219373.429490:0:23554:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219373.429495:0:23554:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_22d: @@@@@@ FAIL: Create /mnt/lustre/d22d.sanity-pfl/f22d.sanity-pfl failed Debug log: 852 lines, 852 kept, 0 dropped, 0 bad.